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PREFACE 


This  interim  report  documents  the  first  phase  of  the  flight  simula- 
tion study  conducted  as  a part  of  Task  2 of  the  All-Weather  Landing  Sys- 
tems Engineering  Support  contract  (DOT  FA75WA-3650) . The  study  was 
carried  out  under  the  technical  direction  of  Mr.  W.  J.  Cox,  FAA  ARD-743. 

The  DC-10  simulation  facility  used  for  this  phase  of  the  investiga- 
tion was  leased  from  the  Douglas  Aircraft  Company  at  Long  Beach,  Cali- 
fornia. Data  collection  was  carried  out  from  19  April  to  14  May  1976. 
Douglas  also  provided  technical  services  in  the  development  of  the  simu- 
lation computer  programs  and  in  the  conduct  of  the  data  collection  activi- 
ties under  the  direction  of  Mr.  Warren  A.  Stephens.  The  contributions 
of  Mr.  Stephens,  Mr.  Art  Torosian,  and  Mr.  John  D.  McDonnell  warrant 
special  mention  and  are  sincerely  appreciated. 

The  important  contributions  of  the  airline  and  FAA  pilots  who  par- 
ticipated in  this  study  also  warrant  special  mention  and  are  hereby 
acknowledged.  Their  cooperation  and  commitment  to  the  goals  of  this 
project  were  remarkable  in  view  of  the  difficulty  of  their  task  as  evalu- 
ators, the  demands  on  their  time,  and  the  midnight-to-dawn  scheduling  of 
simulator  sessions. 
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I INTRODUCTION 


The  simulation  study  documented  in  this  report  is  the  first  phase 
of  an  investigation  of  the  need  for  improved  cockpit  aids  and  procedures 
to  assure  the  safe  conduct  of  terminal  area  operations  under  adverse 
environmental  conditions.  At  the  direction  of  FAA,  this  initial  study 
was  concerned  with  potential  aircraft  operating  problems  in  the  presence 
of  low-level  wind  shear,  and  emphasis  was  placed  on  the  timely  identifica- 
tion of  promising  concepts  and  techniques  for  aiding  pilots  in  anticipat- 
ing and  coping  with  the  effects  of  a shear  encounter. 

Wind  shear  is  generally  characterized  as  a change  in  wind  speed 
and/or  direction  occurring  over  a very  short  distance  in  the  atmosphere. 

An  encounter  with  complex  and  rapidly  changing  wind  conditions  close  to 
the  ground  can  represent  a significant  hazard  to  low-level  flight  opera- 
tions, as  indicated  by  the  following  excerpt  from  a recent  aircraft 
accident  report  (Ref.  1): 

"The  captain  of  Flying  Tiger  161  stated  that  during  his  ap- 
proach...he  experienced  severe  changes  of  wind  direction, 
turbulence,  and  down  drafts  between  the  OM  and  the  airport. 

He  observed  airspeed  fluctuations  of  15  to  30  kn  and  at  300 
feet  he  had  to  apply  almost  maximum  thrust  to  arrest  his 
descent  and  to  strive  to  maintain  140  kn  on  his  inertial 
navigation  system  groundspeed  indicator.  The  aircraft  began 
to  drift  rapidly  to  the  left,  and  he  eventually  had  to  apply 
25°  to  30°  of  heading  correction  to  overcome  the  drift.  He 
believed  that  the  conditions  were  so  severe  that  he  would 
not  have  been  able  to  abandon  the  approach  after  he  had 
applied  near  maximum  thrust,  and  therefore  he  landed." 

About  eight  minutes  after  this  incident  occurred,  another  captain 
initiated  an  approach  to  the  same  runway,  under  similar  and  perhaps  more 
severe  wind-shear  conditions,  and  the  aircraft  crashed  into  the  approach 
lights.  One  of  the  findings  of  the  investigation  of  this  accident  was 
that  the  flight  crew's  apparent  failure  to  recognize  and  correct  the 
aircraft's  high  descent  rate  at  the  low  end  of  the  approach  was  probably 
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due  to  their  reliance  on  degraded  external  visual  reference  rather  than 
on  flight  instruments.  This  accident  report  noted,  however,  that  in 
this  instance  "...adverse  winds  might  have  been  too  severe  for  a success- 
ful approach  and  landing  even  had  they  relied  upon  and  responded  rapidly 
to  the  indications  of  the  flight  instruments." 

The  foregoing  comments  indicate  the  potential  severity  of  the  opera- 
tional hazard  represented  by  the  low-level  wind-shear  encounter  and  serve 
to  highlight  the  central  concern  of  the  present  study.  That  concern  is 
focused  on  the  flight  crew's  ability  to  manage  terminal  area  operations 
in  the  presence  of  shear--i.e.,  their  ability  to  make  timely  decisions 
regarding  the  continuation  of  an  approach  or  takeoff  flight  sequence  and 
their  ability  to  apply  effective  corrective  action  when  unacceptable 
instabilities  in  flight-path  control  occur.  The  investigation  is  centered 
on  the  adequacy  of  information  available  to  the  pilot  in  command,  from 
either  his  flight  instruments  or  external  visual  reference,  for  antici- 
pating the  shear  encounter,  assessing  adverse  effects  on  airspeed  manage- 
ment and  flight-path  control,  and  successfully  coping  with  these  effects 
during  the  shear  encounter. 

A.  Phase  1 Objectives 

In  this  phase  of  the  investigation,  SRI  was  tasked  to  develop  and 
implement  a piloted  flight  simulator  evaluation  of  a set  of  airborne  sys- 
tems and  techniques  designated  by  FAA  as  potentially  effective  aids  to 
pilots  for  detecting  and  coping  with  low-level  wind  shear.  Guidelines 
provided  by  FAA  for  the  conduct  of  Phase  1 stressed  the  urgency  of  carry- 
ing out  a comprehensive  survey  of  potential  pilot  aiding  concepts  that 
would  include  both  near-term,  readily  implemented  systems  and  techniques, 
and  some  systems  requiring  considerable  engineering  development.  The 
principal  intent  of  Phase  1 testing  was  to  provide  an  early  determination 
of  the  potential  operational  effectiveness  of  the  candidate  systems  and 
techniques  that  could  be  used  to  guide  subsequent  in-depth  study  and  de- 
velopment of  the  most  promising  aiding  concepts. 


Accordingly,  Phase  1 data  collection  activities  were  directed  toward 
three  specific  objectives: 

(1)  Determine  pilot  and  aircraft  responses  to  low-level  wind 
shear  under  baseline  conditions-- i . e , , while  conducting 
precision  ILS  approach  and  landing  operations  in  a jet 
transport  airplane  that  is  representative  of  those  in 
current  airline  use,  with  flight  crews  following  estab- 
lished normal  operating  procedure,  and  in  situations  where 
no  alerting  information  is  available  to  the  crew  prior  to 
the  wind-shear  encounter. 

(2)  Explore  differences  in  pilot  and  aircraft  response  to 
shear  under  alternative  aircraft  guidance,  control  mode, 
and  environmental  conditions,  to  include: 

(a)  A conventional  non-precision  approach  using  Visual 
Approach  Slope  Indicator  (VASI)  for  vertical  flight- 
path  guidance. 

(b)  A non-precision  approach  incorporating  a DME-defined 
visual  descent  point  (VDP)  for  initiating  the  close-in 
final  approach  segment. 

(c)  A coupled  approach  to  Category  II  weather  minimums. 

(d)  A takeoff  and  departure  climb-out  using  both  full 
thrust  and  reduced-thrust  procedures. 

(3)  Conduct  screening  evaluations  of  eight  candidate  pilot 
aiding  concepts,  to  include: 

(a)  Wind-shear  advisories  to  the  pilot,  based  on  ground 
sensor  system  data,  indicating  the  expected  direction 
and  severity  of  shear  conditions  at  designated  alti- 
tudes or  segments  of  the  approach. 

(b)  A modified  approach  management  technique  stressing 
the  use  of  off-nominal  flight  situation  indications 
and  providing  a display  of  ground  speed  versus  verti- 
cal speed  for  the  3°  glide  path. 

(c)  The  availability  of  INS  wind  speed  and  direction 
readouts  during  the  approach. 

(d)  A panel  display  of  ground  speed  integrated  with  the 
conventional  airspeed  indicator. 

(e)  A panel  display  of  the  difference  between  the  along- 
track  wind  component  on  the  surface  and  at  the  air- 
craft's present  altitude. 

( f ) A panel  display  of  flight-path  angle  and  potential 
flight-path  angle. 

(g)  A head-up  display  of  flight-path  angle  and  potential 
flight-path  angle. 

(h)  A head-up  flight-path  angle  display  incorporating  the 
wind  difference  indicator  (Item  3-e  above). 


B.  Overview  of  the  Evaluation  Plan 

Phase  1 testing  was  conducted  at  the  Douglas  Aircraft  Company  Flight 
Crew  Training  Center  in  Long  Beach,  using  the  DC-10  training  simulator. 
This  facility  is  an  FAA-certif ied  DC-10  operational  training  device  pro- 
viding a full  complement  of  controls  and  instruments  for  all  flight  crew 
member  positions  and  representing  all  flight  guidance  and  control  modes 
available  on  the  aircraft  in  service  use.  The  simulator  is  equipped  with 
a six-degree-of-freedom  motion  system  and  is  coupled  with  a Vital  III 
computer  generated  imaging  system  for  representing  the  external  visual 
scene.  A more  detailed  description  of  the  facility  and  of  the  modifica- 
tions required  to  represent  the  candidate  pilot  aiding  concepts  is  pre- 
sented in  Section  II. 

The  basic  evaluation  plan  called  for  eight  highly  experienced  pilots 
to  fly  the  simulated  operational  flight  sequences,  first  under  baseline 
conditions  and  then  using  each  of  the  candidate  aiding  concepts.  Four 
different  wind  profiles  were  applied  to  represent  the  demands  imposed  on 
the  pilot  by  the  low-level  shear  situation.  Wind  conditions  represented 
in  the  simulation  were  defined  by  NASA  MSFC  under  a separate  contract  to 
FAA,  and  their  derivation  is  described  in  Ref.  2.  Detailed  plots  of 
wind  speeds,  direction,  and  turbulence  levels  used  in  the  simulation  are 
presented  in  Section  II. 

Data  collection  procedures  were  designed  to  provide  two  kinds  of 
measures  of  the  relative  effectiveness  of  the  aiding  concepts: 

(1)  Pilot  evaluations  of  the  operational  utility  and  limita- 
tions of  each  concept. 

(2)  Objective  measures  of  aircraft  response  to  shear,  based 
on  flight  situation  parameters  reflecting  approach  sta- 
bility and  outcomes. 

Assessments  of  pilot  acceptance  and  workload  were  also  a part  of 
the  evaluation  plan  and  were  used  to  explore  additional  factors  that  may 
affect  the  full  utilization  of  the  aiding  concepts  in  the  operational 
situation.  These  assessments  were  based  on  pilot  responses  to  structured 
debriefing  interviews  conducted  after  each  simulator  session  and  as  each 
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pilot  completed  the  overall  run  schedule.  Data  collection  procedures 
are  described  in  Section  III. 


Study  results  are  presented  and  discussed 
is  concluded,  in  Section  V,  with  an  outline  of 
mendations. 


in  Section  IV.  The  report 
the  conclusions  and  recom- 


' 


A. 


Basic  Aircraft  and  Environmental  Simulation 


! 

■ 


The  DC-10  Training  Simulator  leased  from  the  Douglas  Aircraft  Company 
provided  all  of  the  basic  simulation  capabilities  required  for  Phase  1 
testing,  and  was  modified,  as  subsequently  explained,  to  incorporate  wind 
shear  and  turbulence  models  and  the  test  displays  used  for  the  pilot  aid- 
ing concepts.  The  DC-10  simulator  is  an  FAA  certified  flight  crew  train- 
ing facility  that  has  been  used  for  airline  initial  and  recurrent  training 
since  1971.  It  has  a complete  three-station  crew  compartment,  and  the 
flight  controls,  flight  guidance  system,  flight  instruments,  navigation 
and  communications  equipment,  and  aircraft  subsystems  conform  in  all  re- 
spects to  the  DC-10-10  series  aircraft.  Flight  control  modes  in  the  simu- 
lator included  all  of  the  manual,  autopilot,  and  autothrottle  modes  found 
on  the  aircraft  in  service  use. 

Simulator  response  characteristics,  handling  qualities,  and  perfor- 
mance were  based  on  the  aerodynamic  model  for  the  DC-10-10,  with  a 
350,000-lb  gross  weight  represented  for  the  approach  and  landing  sequences, 
and  a 400,000-lb  gross  weight  on  the  takeoff  runs.  The  simulator  is 
mounted  on  a six-degree-of- freedom  motion  base  and  is  coupled  with  the 
Vital  III  visual  system. 

Vital  III  is  a computer-generated  imaging  system  using  colored  light 
points  to  depict  airport  and  surrounding  city  features.  Shaded  surfaces 
are  also  generated  to  represent  runway  texture,  markings,  numerals,  hori- 
zon glow,  and  other  features.  The  runway  environment  depicted  for  Phase  1 
testing  was  an  approach  over  the  city  to  runway  24  right  and  25  left  at 
Los  Angeles  International  Airport  (LAX).  The  system  could  be  set  up  for 
an  approach  to  either  runway  end,  on  a selective  basis,  provided  a simu- 
lation of  the  VASI  lights,  a "Black  Hole"  effect  achieved  by  deleting 
foreground  lights,  and  visibility  conditions  ranging  from  clear  down  to 
a runway  visual  range  (RVR)  of  IbOO  feet. 


6 


B . Wind-Shear  and  Turbulence  Corn! it.  ions 

The  four  wind-shear  profiles  used  in  the  simulation  were  supplied 
by  FAA  for  the  Phase  1 tests.  They  represent  low-level  wind  shears  that 
might  be  produced  by  four  basic  meteorological  conditions: 

(1)  Wind  conditions  in  a highly  mixed  atmospheric  boundary 
layer  wherein  temperature  stratification  is  consistent 
with  adiabatic  distribution  (9.8°/km). 

(2)  The  condition  of  low-level  temperature  inversion  over- 
laid by  fairly  strong  winds  immediately  above  the  in- 
version. 

(3)  Fast-moving  frontal  zones  producing  significant  turning 
of  the  wind  vector  with  altitude. 

(4)  Thunderstorm  cold  air  outflow  producing  abrupt  changes 
in  both  horizontal  and  vertical  wind  velocities. 

For  convenience,  the  shear  profiles  associated  with  each  of  these 
conditions  will  hereafter  be  referred  to  as  the  "neutral"  profile  (or 
shear  profile  1),  the  "inversion"  profile  (or  shear  profile  2),  the 
"frontal"  profile  (or  shear  profile  3),  and  the  "thunderstorm"  profile 
(or  shear  profile  4),  respectively.  In  the  simulation  these  shear  pro- 
files were  defined  by  tabulated  values  of  the  along-track,  cross-track, 
and  vertical  velocity  components  for  various  altitude  levels  from  the 
surface  up  to  1500  feet.  The  tables  were  stored  in  the  simulation  com- 
puter as  north-south  and  east-west  components  so  as  to  give  the  required 
along-track  and  cross-track  values  for  the  approach  to  runways  24R  and 
25L  at  LAX.  Wind  velocity  components  in  the  tables  were  transformed 
into  the  aircraft  axis  system  where  they  were  summed  with  turbulence 
values,  and  the  results  were  applied  to  the  calculation  of  aircraft  angle 
of  attack,  side  slip  angle,  and  longitudinal  velocity. 

The  wind  profiles  supplied  for  Phase  l testing  were  defined  as  a 
function  only  of  altitude  above  ground  level.  No  variations  in  these 
profiles  were  included  as  a function  of  horizontal  position  along  the 
approach  path.  Thus,  no  change  in  wind  direction  or  velocities  would 
occur  if  the  aircraft  flew  at  a constant  altitude. 

Tabulated  values  of  the  along-track  wind  component  versus  altitude 
for  the  neutral  shear  profile  are  plotted  in  Figure  1.  This  profile  was 
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FIGURE  1 NEUTRAL  WIND-SHEAR  PROFILE 


applied  with  no  variation  of  wind  direction  with  altitude.  Figure  2 is 
a similar  plot  for  the  inversion  profile,  which  was  also  applied  with  no 
cross-track  component.  Along-track  and  cross-track  components  defining 
the  frontal  shear  profile  are  plotted  in  Figure  3.  The  thunderstorm 
profile  was  the  only  shear  condition  with  a significant  vertical  com- 
ponent; all  three  components  of  this  profile  are  plotted  in  Figure  4. 


FIGURE  2 INVERSION  WIND-SHEAR  PROFILE 
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FIGURE  3 FRONTAL  WIND-SHEAR  PROFILE 

To  enhance  the  realism  of  the  simulated  wind-shear  conditions, 
turbulence  was  added  to  Profiles  1,  2,  and  4 (turbulence  levels  associ- 
ated with  the  frontal  shear  were  considered  negligible).  The  values  used 
in  the  simulation  are  listed  in  Table  1 for  each  of  the  shear  profiles. 
Table  entries  are  the  turbulence  levels,  in  knots,  for  each  component  of 
the  designated  wind-shear  profile,  expressed  as  standard  deviations  (o). 
Turbulence  was  represented  in  the  simulator  using  a random  number  genera- 
tor with  conversion  to  a Gaussian  distribution  using  a table  look-up. 


Table  l 


VALUES  OF  TURBULENCE  REPRESENTED  IN  THE 
SIMULATED  WIND-SHEAR  PROFILES 


Shear  Profile 

Alt i tude 
32  ft 

Altitude 
100  ft 

Altitude 
200  ft 

Altitude 
400  ft 

Altitude 
600  ft 

1:  Neutral 

a 

u 

7.68 

5.55 

4.54 

3.71 

3.30 

a 

V 

6.14 

4.73 

4.03 

3.43 

3.12 

a 

w 

2:  Inversion 

3.98 

3.47 

3.19 

2.92 

2.79 

a 

u 

0.88 

1.63 

3.61 

0.50 

0.25 

a 

V 

0.88 

1.63 

3.61 

0.50 

0.25 

a 

w 

4:  Thunderstorm 

0.10 

0.15 

0.25 

0.09 

0.06 

a 

u 

3.50 

4.05 

4.43 

4.85 

5.11 

a 

2.80 

3 . 46 

3.95 

4.50 

4.86 

a 

w 

1 

2.53 

3.53 

4.35 

5.36 

6.05 

a = Standard  deviation  of  longitudinal  velocity, 
u 

0 = Lateral  velocity, 

v 

a = Vertical  velocity. 

w 


The  Gaussian  output  was  passed  through  a first-order  lag  with  a filter 
time  constant  of  0.5  second  on  all  three  axes. 

C . Representation  of  Pilot  Aiding  Concepts 

The  eight  pilot  aiding  concepts  adopted  for  screening  evaluation  in 
the  Phase  1 test  exercise  were  construed  as  alternative  ways  either  of 
alerting  the  flight  crew  to  an  imminent  exposure  to  significant  shear, 
or  of  more  directly  indicating  the  effects  of  the  shear  on  the  airplane 
during  the  shear  encounter.  It  is  important  to  note  that  none  of  the 
candidate  aiding  concepts  were  intended  to  replace  existing  cockpit 
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flight  instruments;  they  were  viewed  as  alternative  ways  of  augmenting 
existing  instruments  that  would  continue  to  be  available  to  the  crew. 

For  purposes  of  Phase  1 testing,  these  concepts  were  defined  in  terms  of 
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1. 

W 

ind-Shear 

Advisories 

The  content,  format,  and  language  used  in  the  wind-shear  ad- 
visories were  developed  by  FAA.  These  advisory  formats  were  preliminary 
and  were  developed  only  for  purposes  of  Phase  1 testing.  The  general 
intent  was  to  provide  a brief  description  of  the  wind  changes  expected 
at  various  points  in  the  approach,  as  illustrated  by  the  following  mes- 
sage for  the  frontal  shear  condition: 

"30  knot  tailwind  at  1500  feet  shifting  to  13  knot  head- 
wind at  250  feet.  Expect  abrupt  26  knot  positive  shear 
between  450  and  250  feet,  followed  by  10  knot  decreasing 
headwind  to  surface.  25  knot  left  crosswind  at  400  feet, 
diminishing  at  touchdown." 

Shear  advisory  messages  for  the  scheduled  wind  condition  were 
presented  to  the  evaluation  pilot  on  a 3-by-5-inch  card  at  the  beginning 
of  the  approach  and  he  was  allowed  as  much  time  as  he  needed  to  read  and 
assimilate  the  information.  Pilots  were  briefed  to  report  their  initial 
go/no-go  decision  regarding  the  continuation  of  the  approach  and  then  to 
continue  in  either  case  so  t Ha t the  approach  outcome  could  be  documented. 
Subsequent  approach  management  decisions  or  changes  in  control  technique 
were  carried  out  at  the  pilot's  discretion. 

2 . VSI  Ground  Speed  Placard 

The  intent  of  this  aiding  concept  was  to  provide  the  pilot  with 
a simple  and  inexpensive  readout  of  ground  speed,  using  an  available  cock- 
pit instrument,  and  thereby  permit  him  to  monitor  the  along-track  wind 


component  throughout  the  approach.  The  display  consisted  of  a placard 
attached  to  the  Vertical  Speed  Indicator  (VSl)  as  shown  in  Figure  5. 

The  scaling  of  the  ground  speed  placard  and  its  alignment  with  the  VSI 
scale  produced  a nomograph  relating  vertical  speed  to  ground  speed  for 
a nominal  3-degree  glide  slope.  As  long  as  the  pilot  was  able  to  main- 
tain this  glide  path  angle,  he  could  use  the  VSI  needle  for  a direct 
reading  of  ground  speed  that  was  independent  of  indicated  airspeed. 

Pilots  were  briefed  to  fly  the  approach  using  the  primary  in- 
struments for  flight-path  control  and  attempt  to  detect  the  shear  by 
monitoring  and  interpreting  the  VSI  placard.  The  technique  of  combining 
ground  speed  with  indicated  airspeed  to  estimate  the  along-track  wind 
component  was  explained.  However,  no  approach  management  or  flight-path 
control  techniques  for  coping  with  shear  based  on  the  use  of  ground 
speed  were  suggested  or  prescribed  for  use  during  the  evaluation  run 
series . 

3 . INS  Wind  Readout 

This  aiding  concept  is  simply  the  conventional  wind  speed  and 
direction  readout  available  on  aircraft  equipped  with  inertial  naviga- 
tion systems  (INS).  For  purposes  of  Phase  1 testing,  it  was  assumed 
that  current  limitations  on  the  availability  of  INS  wind  computations 
at  low  indicated  airspeeds  could  be  eliminated  by  system  design  refine- 
ments and  that  the  wind  readout  would  be  available  throughout  the  ap- 
proach. The  test  display  used  for  the  simulation  was  a six-character 
numeric  readout  located  on  the  center  pedestal,  forward  of  the  throttles, 
as  shown  in  Figure  6.  A computational  Lag  time  of  5 seconds  was  used 
for  the  simulated  wind  data  readout. 

Pilots  were  briefed  to  include  this  readout  in  their  scan  and 
to  attempt  to  estimate  current  wind  effects  by  combining  INS  winds  with 
the  latest  report  of  surface  wind  conditions.  They  were  reminded  of  the 
wind  direction  readout  in  true  rather  than  magnetic  heading,  and  of  the 
5-second  lag  time.  Again,  no  specific  techniques  for  using  this  informa- 
tion for  shear  detection  or  modification  of  approach  control  technique 
were  prescribed. 


4 . Ground  Speed  Display 

In  this  concept,  ground  speed  information  is  presented  in  close 
association  with  indicated  airspeed  to  facilitate  pilot  monitoring  of 
the  along-track  wind  component.  Ground  speed  was  displayed  using  the 
servo-driven  command  airspeed  bug  on  the  Mach/Airspeed  Indicator,  as 
shown  in  Figure  7.  This  display  element  is  an  orange  color,  often  re- 
ferred to  as  the  "salmon  bug"  by  evaluation  pilots. 

For  the  evaluation  of  this  concept  in  the  simulator,  the  normal 
positioning  of  this  display  element  by  pilot  selection  of  a target  ap- 
proach airspeed  was  replaced  by  a drive  signal  based  on  an  air-derived 
ground  speed  computation.  Pilots  were  briefed  to  monitor  ground  speed/ 
airspeed  relationships  to  estimate  wind  ef f ec t s--i . e . , changes  and  trends 
in  the  along-track  wind  component--and  to  compare  these  estimates  with 
surface  wind  information  in  order  to  assess  the  potential  for  shear.  Ap- 
proach management  and  flight-path  control  technique  were  at  the  pilot's 
discretion. 

5 . Wind  Difference  Indicator 

The  intent  of  this  aiding  concept  was  to  eliminate  the  informa- 
tion processing  required  of  the  pilot  in  determining  wind  effects  and  to 
provide  him  with  a more  direct  display  of  the  potential  shear.  This  in- 
dicator consists  of  a panel  mounted  display  of  the  difference  between 
the  along-track  wind  component  at  ground  level,  based  on  reported  surface 
winds,  and  the  same  wind  component  at  the  aircraft's  present  altitude, 
based  on  an  airborne  computation  of  true  airspeed  minus  ground  speed. 

This  "wind  difference"  (hereafter  abbreviated  "AW")  was  displayed  in 
knots  as  shown  in  Figure  8. 

if 

AW  was  computed  by  suotracting  the  wind  component  at  altitude 
from  the  surface  wind.  Positive  values  of  AW  were  displayed  above  the 
zero  (no  difference)  index  and  indicated  a greater  head-wind  component 
(or  lesser  tail-wind  component)  on  the  surface  relative  to  the  winds 
presently  affecting  the  airplane.  Negative  values  of  AW,  displayed  be- 
low the  zero  index,  indicated  a lower  head-wind  component  (or  greater 
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FIGURE  8 TEST  DISPLAY  OF  THE  WIND  DIFFERENCE 


tail-wind  component)  on  the  surface  and  were  thus  intended  to  alert  the 
pilot  to  a decrease  from  the  present  head-wind  component  some  time  be- 
fore arrival  at  the  runway.  It  is  important  to  note  that  this  indicator 
could  only  show  the  difference  in  the  two  wind  components;  the  displayed 
value  would  therefore  change  only  as  the  actual  wind  velocities  changed, 
either  on  the  ground  or  at  altitude.  Indicated  values  of  AW  would  not 
change  with  changes  in  airspeed  and  neither  of  the  two  wind  components 
being  compared  to  provide  AW  is  displayed. 

Pilots  were  briefed  to  monitor  AW  and  to  notice  changes  in  the 
indicated  value  as  the  approach  progressed.  It  was  suggested  that  nega- 
tive readings  would  indicate  a corresponding  net  loss  in  airspeed  some- 
where between  the  aircraft's  present  position  and  the  surface;  reversals 
in  the  wind  velocity  profile  below  the  aircraft's  present  altitude  could 
produce  an  increase  in  airspeed  first  and  then  the  indicated  decrease. 

It  was  further  suggested  that  pilots  add  a "pad"  to  their  previously 
selected  target  approach  speed  to  match  the  amount  of  any  negative  AW 
reading.  For  example,  if  the  approach  bug  speed  was  140  knots  and  the 
AW  indicator  reading  was  -20  knots,  the  pilot  would  fly  150  knots,  modi- 
fying this  speed  pad  as  AW  changed. 

Pilots  were  briefed  to  interpret  positive  values  of  AW  as  indi- 
cations that  they  were  flying  into  an  "increasing  energy"  situation  and 
could  expect  a net  increase  in  airspeed.  The  suggested  airspeed  manage- 
ment technique  with  positive  AW  readings  was  to  maintain  bug  speed  with 
no  extra  additives  and  monitor  AW  for  changes  as  the  approach  progressed. 
At  the  low  end  of  the  approach  the  pilot  might,  at  his  discretion,  esti- 
mate potential  touchdown  speeds  to  be  excessive  and  elect  to  go-around. 

b . Panel  Display  of  Flight-Path  Angle  and 

Potential  Flight-Path  Angle 

Flight-path  angle  is  generally  understood  as  the  aircraft's 
angle  of  climb  or  descent  relative  to  the  horizon.  In  this  study,  flight- 
path  angle  was  derived  from  the  relationship  between  pitch  attitude  and 
angle  of  attack  and  is  therefore  an  a i r-ma ss- ref ercnced  angle  or  air 
velocity  vector;  it  corresponds  to  a ground- referenced  angle,  such  as 
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Che  3-degree  glide  slope,  only  when  the  along-track  wind  component  is 
zero  In  this  discussion,  ground-referenced  flight-path  angles  will  be 
referred  to  as  "climb"  and  "descent"  angles. 

This  distinction  is  important  to  the  intended  application  of 
the  flight-path  angle  display  to  the  wind-shear  problem.  Flight-path 
angle  (hereafter  abbreviated  as  FPA)  was  displayed  on  an  indicator  lo- 
cated above  the  altimeter,  as  shown  in  Figure  9.  Pilots  were  briefed  to 
monitor  FPA  relative  to  a fixed  reference  angle  (black  marker  set  at 
-3  degrees  in  Figure  5)  representing  a 3-degree  glide  slope.  As  long  as 
the  pilot  was  maintaining  the  glide  slope  (by  reference  to  primary  flight 
instruments),  the  FPA  reading  could  be  used  to  estimate  wind  effects. 
Readings  above  the  reference  angle  marker  indicated  a relatively  shallow 
FPA  and,  hence,  a headwind;  relatively  steeper  FPA  readings  (below  the 
marker)  indicated  a tailwind  condition.  Rapid  changes  in  the  FPA  reading 
provided  an  indication  of  wind  shear. 

The  concept  of  a "potential  flight  path"  was  derived  from  early 
work  on  improved  flight  management  displays  for  the  SST  and  from  more 
recent  developments  in  the  head-up  display  of  vertical  guidance  informa- 
tion. Gannett  (Ref.  3)  has  characterized  potential  flight-path  angle 
(hereafter  abbreviated  as  PFPA)  as  a display  element  "...that  responds 
to  acceleration  of  the  aircraft  along  the  flight  path  as  influenced  by 
changes  in  thrust  or  drag."  After  flying  this  kind  of  display  element 
on  the  Thompson-CSF  head-up  display  systems  (CV-91  and  TC-121),  another 
pilot  has  provided  a concise  description  of  PFPA  that  fits  the  concept 
adopted  in  this  study  (Ref.  A): 

"This  is  the  path  the  aircraft  would  fly  when  in  equilib- 
rium, and  it  is  presented  in  such  a way  that  its  relation- 
ship to  the  velocity  vector  is  a measure  of  the  excess, 
or  deficiency,  of  thrust.  When  the  speed  is  stabilized, 
the  potential  path  is  coincident  with  the  actual  path,  or 
velocity  vector.  If  Lhrust  exceeds  drag,  t lie  potential 
path  rises  above  the  velocity  vector  and  results  either 
in  acceleration  (reducing  angle  of  attack)  if  the  velocity 
vector  is  held  constant,  or  in  the  velocity  vector  moving 
up  (with  pitch  attitude)  if  angle  of  attack  is  held  con- 
stant. The  potential  path  is  the  primary  reference  for 
thrust  management." 
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FIGURE  9 TEST  DISPLAY  OF  FLIGHT-PATH  ANGLE  AND  POTENTIAL  FLIGHT-PATH 
ANGLE 
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For  a more  complete  discussion  of  the  PFPA  concept  and  its 
mathematical  derivation,  the  reader  is  referred  to  Wanner  (Ref.  5)  and 
Kiopfstein  (Ref.  6).  In  the  present  study,  PFPA  was  displayed  on  a 
separate  indicator  adjacent  to  the  FPA  indicator  to  facilitate  pilot 
monitoring  of  the  PFPA  reading  relative  to  FPA  (Figure  5).  Pilots  were 
told  that  PFPA  represented  inertial  accelerations  along  the  flight  path 
and  that  it  could  be  used  to  anticipate  the  need  for  throttle  adjustments 
by  monitoring  its  relationship  to  FPA  as  described  in  the  foregoing  quote. 

In  the  simulation,  PFPA  was  derived  from  longitudinal  and  normal  accelera- 
tions resolved  along  the  air  velocity  vector.  The  PFPA  reading  relative 
to  FPA  reflected  configuration  changes  (gear  and  flaps),  thrust  changes, 
and  flight-path  accelerations  induced  by  wind  shear. 

'S 

7 . Head-Up  Display  of  FPA  and  PFPA 

The  inclusion  of  a simulated  head-up  display  (HUD)  in  chase  1 
testing  was  intended  to  represent  a head-up  presentation  of  the  same  in- 
formation as  that  provided  by  the  panel  display  of  FPA  and  PFPA.  In 
coordination  with  FAA,  a minimum  HUD  format  considered  necessary  for 
assessing  the  head-up  presentation  of  FPA  and  PFPA  was  adopted.  A sche- 
matic representation  of  this  HUD  format  is  presented  in  Figure  10. 

The  HUD  symbology  shown  was  generated  bv  the  Vital  III  system 
and  integrated  with  the  simulated  external  visual  scene.  The  display 
elements  are  composed  of  orange  colored  light  points  spaced  close  enough 
to  appear  as  lines  and  generated  brighter  than  the  light  points  used  to 
represent  the  airport  environments.  The  "Reference  Angle"  element 
(circle)  corresponds  to  the  fixed  3-degree  glide-path  reference  index 
in  the  panel  display;  in  the  HUD,  it  is  located  3 degrees  below  the 

horizon  line  and  is  aligned  laterally  with  the  runway  heading.  The  FPA  i 

element  indicates  the  computed  flight-path  angle  relative  to  the  horizon 
and  would  coincide  with  the  reference  angle  only  when  the  aircraft  was 
descending  (through  the  air  mass)  at  -3  degrees. 

A basic  HUD  format  consisting  of  an  aircraft  symbol  and  horizon 
line  for  attitude  reference,  a depressed  sight  line  to  indicate  the 
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FIGURE  10  HEAD-UP  DISPLAY  FORMAT  FOR  PHASE  1 TESTING 

desired  glide-slope  angle,  and  a flight-path  marker  that  shows  the  actual 
vertical  flight-path  angle  of  the  aircraft  was  suggested  more  than  20 
years  ago  by  the  work  of  Calvert  (Ref.  7)  and  Lane  and  Cummings  (Ref.  8). 
In  the  Phase  1 HUD  format,  a fast-slow  indicator  was  added  to  this  basic 
format  for  airspeed  management,  and  the  PFPA  element  was  included  as  an 
extension  of  the  FPA  information.  The  dashed  bars  representing  PFPA 
blend  with  the  FPA  marker  when  inertial  speed  is  stabilized,  rise  above 
the  FPA  marker  to  indicate  acceleration  along  the  flight  path,  and  drop 
below  to  indicate  deceleration. 

Pilots  were  briefed  on  the  use  of  the  HUD  for  the  detection  of 
wind  effects  and  for  flight-path  control.  Wind  effects  were  indicated,  as 
in  the  panel  display  of  FPA,  by  the  position  of  the  FPA  marker  relative 
to  the  reference  angle  circle  while  the  pilot  was  maintaining  a 3-degree 


I 
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glide  path.  The  HUD  format  in  Figure  10  provides  flight-path  control 
guidance  only  when  external  viewing  conditions  allow  the  pilot  to  see 
the  intended  touchdown  point  on  the  runway  (aim  point) . Pilots  were 
briefed  on  the  technique  for  maneuvering  the  aircraft  so  that  the  refer- 
ence angle  circle  was  aligned  with  this  aim  point.  In  order  to  maintain 
the  reference  circle  on  the  runway  aim  point,  the  aircraft  would  have  to 
descend  on  the  3-degree  glide  path  with  its  actual  trajectory  terminating 
at  the  selected  aim  point.  Additional  cues  for  maintaining  lateral  flight- 
path  alignment  were  provided  by  the  runway  and  approach  lights. 

The  FPA  marker  also  provided  roll  attitude  information  and  was 
used  to  facilitate  the  flight-path  control  task  as  well  as  indicate  wind 
effects.  The  suggested  technique  for  correcting  displacements  of  the 
reference  circle  from  the  runway  aim  point  was  to  fly  the  FPA  marker 
toward  and  beyond  the  aim  point  and  then  to  hold  an  offset  position  un- 
til the  change  in  the  aircraft's  trajectory  brought  the  circle  back  in 
alignment  with  the  aim  point.  PFPA  was  used  as  an  anticipatory  cue  for 
thrust  management,  as  described  earlier  for  the  head-down  display. 

8 . Head-Up  Display  of  Wind  Difference 

This  pilot  aiding  concept  was  simply  the  basic  flight-path 
angle  HUD  format  just  described  with  an  additional  display  element.  As 
shown  in  Figure  11,  the  Wind  Difference  Indicator  was  added  to  the  right 
side  of  the  HUD.  It  provided  the  same  information  on  differences  between 
surface  winds  and  winds  at  the  aircraft's  position  as  that  described  for 
the  panel  mounted  instrument,  and  pilots  were  briefed  to  use  it  in  the 
same  manner. 

The  availability  of  this  indicator  head-up  allowed  the  pilots 
to  monitor  wind  differences  deeper  in  the  approach,  beyond  the  point 
where  they  would  typically  transition  to  external  visual  reference.  It 
also  permitted  them  to  cross-check  changes  in  AW  with  wind  effects  indi- 
cated by  the  FPA  and  PFPA  display  elements,  which  were  not  available  when 
the  panel  AW  display  was  used. 
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Ill  STUDY  PROCEDURES 


A.  Evaluation  Pilots 

Phase  1 simulation  exercises  were  designed  primarily  to  expose  expe- 
rienced airline  and  FAA  pilots  to  the  test  wind-shear  profiles  and  to 
obtain  their  assessments  of  the  potential  usefulness  of  the  candidate 
aiding  concepts.  The  eight  pilots  who  participated  in  the  study  were 
recruited  by  FAA  and  consisted  of  six  senior  airline  pilots  and  two  FAA 
pilots.  Seven  of  these  pilots  were  DC-10  qualified  and  one  was  current 
in  the  B-747.  Pilot-in-command  time  ranged  from  8000  to  more  than  21,000 
flying  hours,  with  an  average  of  15,000  hours  for  the  eight  pilots.  DC-10 
flight  time  averaged  760  hours  for  the  airline  pilots  and  about  60  hours 
for  the  two  FAA  pilots. 

Evaluation  pilots  were  scheduled  for  participation  in  the  study  in 
pairs,  with  each  pair  taking  four  days  to  complete  the  full  simulator 
run  schedule.  Simulator  utilization  hours  were  from  0130  to  0730  daily, 
and  pilot  briefings  began  at  approximately  0030. 

B.  Pilot  Briefings 

Similar  briefings  were  given  to  all  pilots  who  participated  in  the 
study.  A comprehensive  initial  briefing  was  given  to  each  pair  of  sub- 
jects when  they  reported  for  the  first  morning's  flying.  This  initial 
briefing  lasted  approximately  one  hour  and  was  designed  to  provide  all 
necessary  background  information  on  the  study  and  describe  the  simulator 
and  procedures  to  be  used.  The  briefing  did  not  describ.  the  number  or 
the  characteristics  of  the  shear  profiles  to  bo  used.  However,  an  audio- 
visual presentation  developed  by  Douglas  to  introduce  pilots  to  the  gen- 
eral characteristic  of  wind  shear  was  included  as  part  of  the  briefing. 
This  slide  show,  entitled  "The  Hostile  Environment,"  was  presented  to 
provide  a common  frame  of  reference  for  the  subsequent  discussions  of 
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wind  shear  and  to  remind  the  pilots  of  the  basic  indicators  of  wind 
shear  available  from  existing  flight  instruments. 

The  initial  briefings  served  as  an  overall  introduction  to  the  pro- 
gram and  to  the  test  personnel.  They  were  conducted  by  the  Test  Director, 
a project  pilot  who  occupied  the  right  seat  to  role-play  as  first  officer, 
and  a Douglas  simulator  engineer  who  manned  the  instructor's  station  to 
manage  run  conditions.  On  some  occasions  other  project  personnel  from 
FAA  and  SRI  were  present  for  these  briefings. 

More  detailed  briefings,  specific  to  each  of  the  aiding  concepts, 
were  given  to  pilots  individually  just  prior  to  the  run  series  in  which 
that  aiding  concept  was  presented.  These  briefings  were  typically  quite 
short  and  were  presented  by  the  Test  Director.  HUD  briefings,  especially 
for  the  pilot's  initial  session  using  the  HUD,  were  given  in  considerable 
detail  and  tended  to  be  longer.  This  was  considered  necessary  because 
the  pilots  were  generally  unfamiliar  with  HUD,  and  none  had  seen  the 
simulated  HUD  before. 

C.  Pilot  Exposure  to  Test  Conditions 

The  relatively  large  number  of  aiding  concept  and  shear  combinations 
argued  for  varying  the  order  of  exposure  to  test  conditions  in  order  to 
preclude  any  bias  due  to  learning  or  fatigue  effects  that  might  carry 
over  from  one  run  condition  to  another.  Accordingly,  each  pair  of  pilots 
flew  the  aiding  concept  in  a different  order.  All  pilots  flew  simulator 
familiarization  (two  approaches),  initial  baseline  (eight  approaches), 
and  training  effect  (two  approaches)  runs  on  their  first  day,  in  that 
order.  After  this  initial  baseline  series,  however,  the  order  of  condi- 
tions was  varied.  Table  2 illustrates  a typical  scheduling  of  simulator 
sessions  for  one  pair  of  evaluation  pilots.  The  presentation  of  shear 
profiles  was  also  varied  for  each  aiding  concept  to  control  for  carry- 
over effects  and  to  minimize  pilot  learning  of  the  shear  profiles. 

The  HUD  sessions  were  treated  as  a block  because  of  the  special 
briefings  and  training  approaches  required  for  familiarization  with  the 
display  characteristics.  Accordingly,  the  schedule  was  arranged  so  that 
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the  HUD  was  taken  up  at  the  beginning  of  a day  and  most  of  the  HUD  ap- 
proaches could  be  completed  during  that  day's  flying.  The  "HUD  day," 
however,  was  scheduled  on  different  week  days  for  each  pilot  pair. 


D.  Data  Run  Procedures 

Before  initiating  an  approach,  the  first  officer  provided  the  evalu- 
ation pilot  with  a flight  condition  or  "weather"  card.  This  card  was 
placed  on  the  console  and  showed  the  weather  conditions  for  the  approach 
to  be  flown,  the  aircraft  landing  weight,  and  the  applicable  speed  require- 
ments for  the  weight  and  flap  setting.  The  information  on  this  card  was 
used  each  time  by  the  evaluation  pilot  to  set  up  his  approach  and  to  choose 
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his  approach  target  speed  based  on  the  reported  surface  winds.  The  sur- 
face winds  presented  were  correlated  with  the  shear  profile  being  flown. 

Surface  wind  direction  and  velocities  were  changed  slightly  at  times  to 
prevent  the  evaluation  pilot  from  becoming  too  familiar  with  the  associated 
shear  profiles. 


The  approaches  flown  during  this  study  were  conducted  as  nearly  like 
routine  air  carrier  operations  as  possible.  Pilots  were  requested  to 
manage  their  approaches  just  as  they  would  on  the  line,  including  the 
go-aroend  decision  when  necessary.  The  Los  Angeles  International  Airport 
(LAX)  was  selected  as  one  with  which  most  evaluation  pilots  were  familiar, 
and  standard  approach  charts  for  this  airport  were  used,  with  only  slight 
modifications  to  incorporate  the  VAST  and  the  Visual  Descent  Point.  The 
approach  plate  for  the  ILS  approach  to  runway  24R  is  reproduced  in  Figure 
12.  Non-precision  approaches  were  flown  using  the  approach  plate  for  run- 
way 25L,  modified  as  shown  in  Figure  13. 


Each  simulated  approach  was  initiated  9 miles  from  the  airport  at 
the  initial  approach  altitude  (2200  feet  for  24R  and  1900  feet  for  25L). 

The  simulator  was  set  up  on  course  and  heading,  in  the  initial  approach 
configuration  (gear  up,  22  degree  flap  setting)  at  175  knots  airspeed, 
and  in  trim  with  appropriate  power  settings.  All  checklists  were  assumed 
to  have  been  completed  with  the  exception  of  the  final  landing  check  list. 
Flight  directors,  course  selectors,  radios,  and  altimeters  were  all  pre-set 
bv  the  first  officer.  The  approach  was  started  when  the  evaluation  pilot 


advised  he  was 


ready. 
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The  approach  was  conducted  by  each  individual  evaluation  pilot  in 
accordance  with  his  own  procedures.  Gear  and  flaps  were  lowered  by  the 
first  officer  at  the  pilot's  command.  All  normal  call-outs  were  made  by 
the  first  officer  and  included  at  least  the  following: 

(1)  Glide  slope  active  (or  approaching  non-precision  fix 

(2)  Passage  of  outer  marker  or  non-precision  fix 

(3)  Completion  of  final  landing  check  list 

(4)  Altitude,  airspeed,  and  rate  of  descent  as  requested  by 
the  individual  pilot 

(5)  Approaching  and  reaching  minimums 

(6)  Lights  and  runway  sightings 

(7)  Missed  approach  points. 

Each  evaluation  pilot  made  his  own  decision  about  landing  or  going 
around,  and  all  first  officer  call-outs  were  modified  as  requested  to 
meet  the  stated  requirements  of  the  individual  pilots.  After  each  land- 
ing the  simulator  was  frozen  at  nose  wheel  touchdown  and  reset  back  to 
the  initial  position  for  the  next  run.  On  go-arounds,  the  simulator  was 
frozen  as  soon  as  the  aircraft  was  stabilized  with  a positive  rate  of 
climb,  and  reset  was  then  accomplished. 

Most  approaches  flown  in  the  study  were  ILS  approaches  to  runway 
24R  under  Cat-1  weather  minimums  (300-foot  ceiling,  2400-foot  RVR) . 

These  approaches  were  flown  manually  by  reference  to  the  flight  director, 
and  autothrottles  were  not  used.  The  transition  to  external  visual  refer- 
ence for  flare  and  landing  was  below  300  ft  and  at  the  pilot's  discretion. 

Coupled  ILS  approaches  ore  flown  in  the  Cat-II  visibility  conditions. 
Autopilot  and  autothroti  re  used  down  to  the  100-foot  decision  height 

where  the  automatic  system-  t re  disengaged  and  the  landing  maneuver  was 
accomplished  manually  by  ext  rnal  visual  reference. 

Nonprecision  approaches  were  Localizer-only  approaches  to  runway 
25L,  simulating  a failure  in  the  glide-slope  system.  The  approach  plate 
was  slightly  modified  by  eliminating  the  LAKE  fix  at  1.6  NM  on  the  ILAX 
DME  and  substituting  the  visual  descent  point  (VDP)  fix  at  1.2  NM  on  the 
ILAX  DME.  The  MDA  was  also  changed  to  allow  descent  to  460  feet  MSL 
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immediately  after  leaving  the'  outer  marker,  instead  of  maintaining  620 
feet  MSL  to  LAKE.  Approach  procedures  for  the  non-precision  approaches 
were  similar  to  those  already  described  for  initial  simulator  position- 
ing, configuration,  and  airspeed.  On  these  approaches,  the  first  officer 
called  out  approaching  and  passing  fixes,  and  MDA,  in  addition  to  the  nor- 
mal altitude/airspeed  call-outs.  The  initiation  of  the  descent  and  the 
descent  rate  were  at  the  discretion  of  the  pilot  in  command. 

Four  takeoffs  were  also  included  in  the  master  run  schedule.  A simu- 
lated aircraft  gross  weight  of  400,000  pounds  was  used  for  these  runs, 
and  both  maximum  thrust  and  reduced  thrust  takeoffs  were  made.  Only  two 
of  the  test  shear  profiles  were  considered  appropriate  for  the  takeoff 
sequences.  The  frontal  and  thunderstorm  profiles  were  used  to  represent 
a head-wind  shearout  during  the  departure  climbout. 

On  the  takeoff  runs,  the  first  officer  called  out  airspeeds  and 
actuated  gear  and  flaps  as  directed  by  the  pilot  in  command.  Callouts 
of  Vq,  V2,  and  were  normally  requested.  Takeoff  runs  were  terminated 
when  an  altitude  of  approximately  1200  feet  was  reached. 

E.  Data  Collection 

Two  distinct  kinds  of  data  were  collected  during  the  study:  (1) 
pilot-generated  data,  including  comments,  opinions,  and  aiding  concept 
ratings  provided  by  each  evaluation  pilot,  and  (2)  quantitative  flight 
situation  data  recorded  on  magnetic  tape  ar  strip  chart  recorders.  The 
two  sources  of  data  complement  each  other.  Pilot  assessments  of  the 
effectiveness  of  the  aiding  concepts  were  contrasted  with  objective  rec- 
ords of  approach  outcomes. 

Pilot  generated  data  were  obtained  following  each  simulator  run 
and  in  debriefing  sessions.  Pilot  comments  during  and  immediately  after 
each  approach  were  recorded  on  the  first  officer's  inflight  data  card. 

This  card  was  also  used  to  record  the  evaluation  pilot's  rating  on  his 
performance  and  work  load  on  each  approach.  These  ratings  were  using  a 
scale  of  one  (best)  to  seven  (worst).  It  was  expected  that  pilot  com- 
ments and  ratings  recorded  immediately  following  the  approach  would  be 
free  of  influence  by  other  approaches  or  test  conditions. 
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Pilot  debriefings  were  conducted  following  each  session  in  the  simu- 
lator, for  each  pilot,  and  at  the  end  of  the  week's  participation  for 
each  pair  of  pilots  jointly.  The  session  debriefings  were  normally  con- 
ducted by  the  Test  Director  alone,  although  other  team  members  or  official 
visitors  sometimes  observed.  The  debriefings  were  loosely  structured  to 
allow  the  pilots  a maximum  opportunity  for  comment  without  being  led  to- 
ward an  answer. 

End-of-the-week  debriefings  were  usually  more  crowded,  with  all  of 
the  regular  test  team  plus  both  pilots  and  ordinarily  several  visitors 
present.  Structure  again  was  kept  quite  loose  to  allow  maximum  free 
comment.  Pilots  were  asked  to  make  "best"  and  "second  best"  choices 
from  the  aiding  concepts  they  had  seen  during  the  week.  All  pilot  de- 
briefing comments  were  recorded  on  cassette  tapes  for  subsequent  tran- 
scription and  detailed  study. 

At  the  initial  program  briefing,  each  evaluation  pilot  completed  an 
experience  history  form,  primarily  to  evaluate  his  total  and  recent  DC-10 
experience.  Each  was  also  asked  whether  he  had  had  prior  experience 
with  head-up  display,  flight-path  angle,  ground  speed,  or  inertially 
sensed  wind  displays.  Following  his  week's  flying,  each  pilot  was  given 
a 27-item  questionnaire  to  complete  and  return.  The  questionnaire  was 
used  to  obtain  comparative  judgments  of  aiding  concepts  and  to  ask  for 
opinions  as  to  how  the  concepts  might  be  improved. 

A comprehensive  set  of  flight  situation  parameters  and  events  was 
recorded  on  digital  magnetic  tape,  at  a sampling  rate  of  5 samples  per 
second,  for  subsequent  quantitative  analysis.  These  parameters  are  listed 
in  Table  3.  In  addition,  a digital  printer  triggered  by  main  gear  touch- 
down printed  the  values  of  several  parameters  describing  touchdown  per- 
formance, and  an  8-channel  strip  chart  recorder  was  used  for  quick-look 
monitoring  of  performance  during  the  approach. 


Table  3 


FLIGHT  SIMULATION  PARAMETERS  RECORDED  ON  MAGNETIC  TAPE 


Parameter 

Unit 

Range 

Resolution 

Elapsed  time 

sec 

0-600 

0.2  sec 

Longitudinal  position 

ft 

-20K  to  50K 

1 ft 

Lateral  position 

ft 

t 2K 

1 ft 

Vertical  position 

ft 

0-2K 

1ft 

Heading  error 

deg 

± 30 

0.1  deg 

Sideslip  angle 

deg 

± 10 

0.1  deg 

Pitch  angle 

deg 

± 30 

0.1  deg 

Roll  Angle 

deg 

± 30 

0.1  deg 

Vertical  speed 

f t/sec 

± 50 

1 ft/sec 

Airspeed 

kt 

0-300 

1 kt 

Ground  speed 

kt 

0-250 

1 kt 

Cross-track  velocity 

ft/sec 

± 25 

0.1  ft/ sec 

Longitudinal  acceleration 

f t/sec^ 

± 5 

0. 1 ft/sec2 

Normal  acceleration 

ft/ sec^ 

± 30 

0.1  ft/ sec^ 

Pitch  rate 

deg/seQ 

± 10 

0. 1 deg/sec 

Roll  rate 

deg/sec 

± 10 

0. 1 deg/sec 

Elevator  deflection 

deg 

± 64 

0.1  deg 

Rudder  deflection 

deg 

± 64 

C.l  deg 

Aeleron  deflection 

deg 

± 64 

0.1  deg 

Pitch  acceleration 

rad/sec^ 

± 3 

0.1  rad/sec^ 

Control  column  position 

inches 

± 8.97 

0. 1 inch 

Control  wheel  position 

deg 

± 90 

0. 1 deg 

Rudder  pedal  position 

inches 

i 4.24 

0. 1 inch 

Throttle  position 

deg 

0-256 

0.1  deg 

Horizontal  stabilizer  position 

deg 

-5  to  +15 

0.  1 deg 

Flap  position 

deg 

0-50 

deg 

Flight-path  angle  (air) 

deg 

1 10 

0.  1 deg 

Potential  flight-path  angle  (air) 

deg 

i 10 

0.1  dog 

Wind  speed  (along  track) 

kt 

t 60 

0.1  kt 

Wind  speed  (cross  track) 

kt 

t 40 

0.1  kt 
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Table  3 (concluded) 
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Unit 

Range 

Resolution 

kt 

± 20 

0.1  kt 

deg 

± 10 

0.1  deg 

deg 

± 25 

0.1  deg 

mV 

± 15 

0.  1 mV 

mV 

± 15 

0.1  mV 

kt 

0-200 

1 kt 

% 

0-100 

1% 

ft 

0-2K 

1 ft 

deg 

0-20 

1 deg 

nm 

0-10 

0.1  nm 

nm 

0-10 

0. 1 nm 

deg 

0-360 

0.  1 deg 

deg 

0-360 

0.1  deg 

kt 

t 60 

1 kt 

IV  RESULTS  AND  DISCUSSION 

Implementation  of  the  test  procedures  described  in  the  preceding 
section  generated  pilot  evaluations  and  flight  situation  data  on  a total 
of  512  simulator  runs.  These  data  were  reduced  to  derive  two  principal 
indicators  of  the  relative  effectiveness  of  alternative  pilot  aiding 
concepts : 

(1)  Pilot  assessments  of  the  potential  operational  utility 
and  limitations  of  each  of  the  aids. 

(2)  Approach  outcomes -- i. e. , objective  determinations  of  the 
effectiveness  of  approach  management  and  flight-path  con- 
trol based  on  aircraft  state  parameters  at  100  feet  (Inner 
Marker)  and  at  touchdown. 

The  screening  of  candidate  pilot  aiding  concepts  was  based  primarily 
on  contrasts  with  baseline  conditions,  and  data  reflecting  pilot  reactions 
and  performance  under  these  conditions  are  presented  first.  As  indicated 
earlier,  the  term  "baseline"  is  used  to  refer  to  the  fact  that  no  augmen- 
tation of  existing  cockpit  instrumentation  or  flight  crew  procedures  is 
available  to  the  pilot;  within  the  context  of  this  study,  such  conditions 
may  therefore  be  construed  as  "unaided".  The  subsequent  discussion  of 
the  outcomes  of  the  screening  evaluations  will  examine  contrasts  between 
different  aiding  concepts  as  well  as  their  relationship  to  baseline  condi- 
t ions . 

Phase  1 testing  was  carried  out  as  an  exploratory  study,  covering  a 
diverse  set  of  operational  conditions  and  of  incompletely  developed  aid- 
ing concepts.  Within  the  time  and  resource  constraints  imposed  on  this 
phase  of  the  program,  a fully  controlled  experimental  evaluation  of 
each  aiding  concept  and  alternative  operational  context  was  not  feasible 
and  was  not  attempted.  Accordingly,  relatively  greater  emphasis  was 
placed  on  pilot  assessments  of  the  potential  usefulness  of  the  candidate 
aiding  concepts,  and  quantitative  data  reflecting  differences  between 
aiding  concepts  were  not  analyzed  for  statistical  significance.  Quanti- 
tative data  were  recorded  primarily  to  provide  a basis  for  detailed 
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analyses  of  pilot  and  aircraft  responses  to 
tions  following  a case  study  approach  for  a 
t ions. 

A.  Pilot  Assessments  of  Baseline  Performance 
1.  Simulation  of  Wind-Shear  Profiles 

Immediately  following  their  exposure  to  the  simulated  wind 
shears  under  baseline  conditions,  pilots  were  asked  to  express  their 
reactions  to  the  realism  and  severity  of  the  shears  and  to  comment  on 

their  ability  to  detect  them.  They  were  also  asked  to  critique  the  . 

overall  simulation  (i.e.,  aircraft  response,  visual  scene,  turbulence, 
etc.),  especially  in  regard  to  any  features  they  felt  might  degrade  their 
performance  or  ability  to  assess  the  shears. 

The  simulated  shear  conditions  were  generally  regarded  as 
"realistic  but  rarely  encountered,"  with  most  of  the  reservations  about 
realism  referred  to  shear  profile  4 (thunderstorm  shear).  With  only 
one  exception,  the  pilots  stated  that  they  had  never  encountered  wind- 
shear  effects  as  great  as  those  represented  in  the  simulation.  Never- 
theless, even  the  more  severe  shears  were  accepted  as  reasonable,  and 
pilots  were  impressed  with  the  potential  training  value  of  exposure  to 
them  in  the  simulator.  As  one  pilot  put  it: 

"I  think  it's  educational  to  see  some  of  those  excessive  or 
high  shears  in  there,  because  I think  very  few  pilots  have 
ever  been  exposed  to  those  kind  of  shears. . .what  I'm  saying 
is  I think  you  have  to  train  on  some  of  these  things  in  the 
simulator  - more  than  we  have  in  the  past... they  talk  about 
it,  but  until  the  guy  has  gone  down  there  and  witnessed  his 
speed  bouncing  around  and  the  high  sink  and  landed  short  a 
few  times,  it  doesn't  make  much  of  an  impress  ion. .. i t makes 
a much  greater  impression  when  you  bounce  the  thing  off  the 
approach  lights  and  see  that  that  could  happen  in  the  real 
world." 

Pilot  reactions  to  the  simulated  turbulence  conditions  were 
so  positive.  Six  of  the  eight  pilots  commented  that  the  turbulence 
not  realistic.  Some  felt  that  the  airspeed  indicator  movements  were 
abrupt  ("too  jerky")  and  that  for  such  indications  the  motion  system 
not  produce  an  appropriate  level  or  rate  of  cab  movement. 
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Most  of  the  pilots  reported  that  their  first  and  clearest  indi- 
cation of  the  shear  was  a change  in  airspeed,  with  one  pilot  adding  simul- 
taneous displacement  from  the  glide  slope  to  the  airspeed  change.  Vertical 
speed  was  mentioned  by  two  of  the  pilots  as  a secondary  indication  of 
shear,  saying  it  was  less  frequently  used  because  it  is  outside  of  the 
primary  instrument  scan  pattern. 

In  their  critique  of  the  overall  simulation,  pilot  comments 
were  generally  favorable.  The  most  common  complaint  was  that  roll  re- 
sponse was  too  sensitive  (control  loading  seemed  to  be  much  lighter  than 
in  the  aircraft)  and  some  of  the  pilots  felt  that  the  simulator's  re- 
sponse to  pitch  and  throttle  inputs  was  too  slow.  Only  one  of  the  pilots 
felt  that  discrepancies  in  the  simulator's  handling  qualities  were  adversely 
affecting  his  performance. 

2 . VAST  and  VDP  Procedure 

Six  of  the  eight  pilots  flew  the  night  visual  approach  using 
VASI  as  an  aid  for  glide-path  control.  All  of  them  feit  that  the  VASI 
simulation  was  the  best  that  they  had  seen  in  a simulator,  but  some  of 
them  noted  that  it  was  too  "sensitive"  in  that  red-white  color  changes 
occurred  too  abruptly.  Comments  on  the  usefulness  of  VAST  for  detecting 
the  shear  were  favorable  in  all  instances.  The  pilots  felt  that  depar- 
tures from  the  3-degree  glide  slope  were  easily  detected  and  that  this 
gave  them  a clear  and  timely  indication  of  the  shear  effects. 

Pilots  felt  that  the  VAST  as  simulated  could  provide  trend  infor- 
mation as  well  as  discrete  position,  and  were  able  to  fly  specific  light 
combinations  (red  over  two  whites,  or  two  reds  over  one  white)  as  desired. 
Reports  indicated  that  the  pilots  were  able  to  detect  developing  shears 
by  observing  the  VASI  color  changes,  and  to  go  around  on  the  "3  red" 
indication.  Their  general  opinion  was  probably  effectively  summarized 
by  the  pilot  who  said,  "Some  guidance  is  better  than  no  guidance." 

All  pilots  who  flew  the  VDP  procedure  recognized  the  value  of 
a clear  indication  of  when  to  initiate  the  final  descent  on  a non-precision 
approach,  but  the  consensus  was  that  the  procedure  did  not  provide  any 
assistance  for  detecting  or  coping  with  wind  shear.  Two  of  the  pilots 
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recognized  that  the  DME  information  might  be  useful  in  determining  wind 
effects  (e.g.,  by  noting  its  rate  of  change  or  the  DME  position  on  arrival 
at  the  MDA),  but  the  availability  of  the  VDP  fix,  per  se,  could  not  be 
related  to  the  wind-shear  problem. 


3.  The  Coupled  Approach 

The  six  pilots  who  flew  the  coupled  approach  in  simulated  Cate- 
gory II  weather  were  generally  relieved  to  have  the  autopilot  and  auto- 
throttle systems  cope  with  the  shears.  They  all  believed  that  the  auto- 
matics performed  very  well  in  delivering  the  aircraft  to  an  acceptable 
position  for  the  manual  takeover  at  the  100-foot  decision  point.  They 
also  felt  that  the  reduced  workload  and  the  time  available  to  concentrate 
on  the  approach  management  task  enabled  them  to  do  a better  job  of  detect- 
ing shear  effects.  As  one  pilot  put  it:  "...there's  no  question  about 
it,  I think  you  can  do  a much  better  job  of  flying  any  kind  of  turbulence 
or  shear  using  the  coupler." 

One  of  the  more  perceptive  pilots  noted  the  importance  of  auto- 
throttle performance  in  producing  this  level  of  pilot  confidence: 

"A  good  set  of  autothrottles  with  the  acceleration  term  is  es- 
sential if  you  intend  to  use  the  couplers  in  negotiating  turbu- 
lence and  shear  conditions. .. I think  without  that  you  would  not 
be  able  to  use  them... I think  this  is  a way  to  go,  but  I stress 
that  the  throttles  must  have  the  right  smarts." 

4.  The  Takeoff  Runs 

Pilot  debriefings  on  this  test  condition  were  focused  on  the 
usefulness  of  the  simulated  PIREPS  (pilot  reports)  provided  just  prior 
to  takeoff.  Most  of  the  pilots  (5  out  of  6)  felt  that  these  reports 
helped  them  to  anticipate  the  airspeed  changes  during  climbout.  None 
felt  that  management  of  the  shear  encounter  during  climbout  was  partic- 
ularly challenging  with  all  engines  operating,  even  in  the  reduced 
thrust  condition. 
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Approach  Outcomes  for  Baseline  Conditions 

Figure  14  presents  an  overview  of  approach  outcomes  for  the  alterna- 
tive baseline  test  conditions.  Three  components  of  the  approach  outcome 
are  represented  in  these  data  plots.  The  plot  at  the  top  of  Figure  14 
shows  the  proportion  of  go-arounds  flown  under  each  baseline  condition 
(number  of  go-arounds  relative  to  the  total  number  of  approaches  attempted). 
The  next  plot  down  is  based  on  a count  of  within-1 imits  approach  outcomes 
derived  from  data  on  aircraft  position  and  tracking  tendencies  at  a glide 
slope  height  of  100  feet.  The  plot  at  the  bottom  of  the  figure  is  based 
on  a count  of  wi thin- 1 imits  landings  derived  from  touchdown  data. 

An  approach  was  counted  as  "within  limits"  if,  at  the  range  correspond- 
ing to  a glide-slope  height  of  100  feet,  the  aircraft  was  within  +75  feet 
of  the  extended  runway  centerline,  tracking  so  as  to  remain  within  these 
limits,  and  within  +28  feet  of  the  glide  slope  (two  dots).  The  data  points 
are  the  number  of  wi thin-1 imits  approaches  relative  to  the  total  number 
of  completed  approaches;  this  means  that  the  approaches  resulting  in  go- 
arounds  were  not  included  in  the  derivation  of  these  proportions. 

The  data  points  for  landings  are  based  on  the  same  subsets  of  com- 
pleted approaches  as  those  used  for  the  approach  outcomes,  and  are  also 
shown  here  as  proportions.  Landings  were  counted  as  within  limits  when 
touchdown  paramaters  satisfied  the  following  conditions: 

(1)  Wheel  contact  occurred  within  the  touchdown  zone  (threshold 
to  3000  feet  down  the  runway)  and  with  the  midpoint  of  the 
aircraft  within  150  feet  of  the  centerline. 

(2)  Rate  of  descent  was  10  ft/sec  or  less. 

(3)  Lateral  velocity  was  less  than  14. S ft/sec. 

(4)  Pitch  attitude  was  less  than  13  degrees. 

(5)  Roll  attitude  was  less  than  9 degrees. 

Separate  data  plots  are  provided  in  Figure  14  for  the  pilot's  first' 
(ILS-1)  and  second  (ILS-2)  exposure  to  the  four  wind-shear  conditions  on 
the  manually  flown  precision  approach  runs.  Outcomes  of  the  two  replica- 
tions of  the  precision  approach  for  shear  profiles  2 and  3 are  plotted 
next  (TRNG)  to  indicate  training  effects.  The  last  three  plots  are  for 
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FIGURE  14  SUMMARY  OF  APPROACH  OUTCOMES  FOR  ALTERNATIVE  BASELINE  TEST 
CONDITIONS 
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the  non-precision  approaches  using  VAST,  the  VDP  procedure,  and  the 

! 

coupled  approach  to  the  Category  II  decision  height.  Data  points  in 
each  plot  are  coded  to  distinguish  the  effects  of  the  different  wind- 
shear  conditions  using  the  following  symbols: 

| 

■ Represents  the  neutral  boundary  layer  shear  (WS-1) 

□ Represents  the  night  time  inversion  shear  (WS-2) 

A Represents  the  frontal/directional  shear  (WS-3) 
a Represents  the  thunderstorm  gust  front  shear  (WS-4) 

The  data  indicate  some  training  effect  across  initial  baseline  run 
series  (ILS  and  TRNG)  with  a slight  trend  toward  fewer  go-arounds  and  a 
higher  proportion  of  within-limits  approaches  to  100  feet.  However,  no 
training  effect  is  apparent  in  the  touchdown  plots.  Approach  performance 
on  the  extended  baseline  series  (VAST,  VDP,  COUPLED)  show  the  relatively 
greater  effects  of  differences  in  test  conditions  and  shear  profiles. 

On  the  VASI  approaches  for  shear  profiles  1 and  2,  there  were  no 
go-arounds,  and  all  touchdowns  were  within  limits.  However,  this  result 
is  probably  due  to  the  unrestricted  visibility  condition  on  this  run 
series  rather  than  to  the  guidance  provided  by  the  VASI.  Notice  that 
performance  on  the  more  severe  profiles  (3  and  4)  is  at  about  the  same 
level  as  initial  baseline. 

The  spread  on  VDP  runs  is  due  in  part  to  the  smaller  number  of  runs 
completed  for  this  condition  (5  rather  than  8).  Approach  outcomes  appear 
to  be  somewhat  better  than  initial  baseline  for  shear  profiles  1 and  2, 
and  about  the  same  or  worse  for  shears  3 and  4. 

The  expected  improvement  in  approach  outcomes  for  the  coupled  condi- 
tion was  obtained  only  for  shear  profiles  1 and  2.  There  were  compara- 
tively few  go-arounds  (1  out  of  6)  on  the  frontal  shear  (WS-3);  however, 
data  for  both  the  approach  to  100  feet  and  the  landings  for  the  coupled 
approaches  show  consistently  poorer  performance  than  initial  baseline 

for  this  shear.  The  proportion  of  go-arounds  for  the  thunderstorm  shear  • 

(WS-4)  was  4 out  of  5,  somewhat  higher  than  initial  baseline  conditions.  jj 

This  result  may  be  due  in  part  to  the  combination  of  the  severe  down- 
draft  associated  with  this  shear  and  the  very  low  visibility  condition 
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(1600  feet  RVR).  The  1.0  proportion  of  within-1 imits  touchdowns  for 
this  condition  may  be  misleading,  since  it  is  based  on  only  one  completed 
approach. 
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When  the  number  of  within-1 imits  landings  is  related  to  the  total 
number  of  approaches  attempted,  the  overall  proportions  of  within-limits 
touchdowns  across  wind-shear  conditions  are  as  follows: 

(1)  For  the  ILS  approach  (ILS  1 and  2),  it  is  31  out  of  60, 
or  52%. 

(2)  For  the  non-precision  approach  using  VASI,  it  is  17  out 
of  24  or  71%. 

(3)  For  the  non-precision  VDP  approach,  it  is  10  out  of  21 
or  48%. 

(4)  For  the  coupled  ILS  approach,  it  is  11  out  of  22  or 
50%. 

Comparisons  among  the  alternative  baseline  conditions  are  confounded 
by  differences  in  weather  conditions  and  guidance  represented  in  the  simu- 
lation. Moreover,  the  interpretation  of  these  results  must  be  tempered 
by  a consideration  of  the  small  number  of  approaches  on  which  they  are 
based.  However,  the  data  indicate  that  considerable  augmentation  of 
baseline  capability  will  be  required  if  pilots  are  to  cope  successfully 
with  the  kinds  of  low-level  wind-shear  conditions  represented  in  this 
s tudy. 

C . Pilot  Assessments  of  Candidate  Aiding  Concepts 

1 . Ranking  of  Aiding  Concepts 

In  the  general  debriefing  sessions  conducted  after  their  exposure 
to  the  full  set  of  candidate  aiding  concepts,  the  evaluation  pilots  were 
asked  to  make  "best"  and  "second  best"  choices.  Six  of  the  eight  pilots 
selected  the  Ground  Speed  display  as  their  first  choice,  and  two  preferred 
the  Wind  Difference  Indicator.  There  was  considerably  less  consensus  in 
their  selections  of  the  second-best  aiding  concept,  with  four  pilots 
choosing  some  version  of  the  Wind  Difference  Indicator,  three  preferring 
the  INS  Wind  Readout,  and  one  reluctantly  stating  that  the  Shear  Advisories 
would  be  his  second  choice.  Preferences  expressed  for  the  Wind  Difference 


>. 


f 


. 


1 


44 


* 


Indicator,  as  either  a first  or  second  choice,  were  accompanied  in  all 
instances  by  the  qualification  that  the  panel  mounted  test  display  was 
unacceptable  due  to  its  location  out  of  the  normal  instrument  scan  and 
to  difficulties  in  reading  the  display. 

The  completed  questionnaires  received  some  time  after  the  run 
series  from  five  of  the  eight  pilots  tended  to  confirm  the  rankings  of 
Ground  Speed  and  the  Wind  Difference  Indicator  as  the  most  useful  aiding 
concepts.  The  questionnaire  also  called  for  a rank  ordering  of  the 
other  aiding  concepts,  including  VASI  and  the  VDP  procedure.  There  was 
very  little  agreement  among  the  five  responding  pilots  regarding  the 
particular  ranking  of  each  concept.  For  example,  the  INS  Wind  Readout 
was  ranked  from  first  to  ninth.  Shear  advisories  were  rated  from  third 
to  tenth,  and  the  Head-up  Display  was  rated  from  third  to  ninth.  How- 
ever, the  pattern  of  choices  could  be  reduced  to  the  following  rank 
ordering: 


1st 

Ground  Speed 

2nd 

VASI 

3rd 

Head-up  Display 

of  Wind  Difference 

4th 

INS  Wind  Readout 

5th 

Head-up  Display 

of  Flight  Path  Angle 

6 th 

Panel  Display  of 

Wind  Difference 

7 th 

Shear  Advisories 

8 th 

Panel  Display  of 

Flight  Path  Angle 

9th 

VDP  Procedure 

10th 

VSI-G round  Speed 

Placard. 

Pilot  critiques  of  each  tiding  concept,  based  on  post-session 
debriefings  and  on  the  observations  of  test  personnel,  are  summarized 
and  discussed  below. 

2 . Ground  Speed  Display 

The  rationale  most  often  given  for  the  first-place  ranking  of 
this  aiding  concept  was  that  it  was  easy  to  read  and  interpret.  They 
liked  the  convenient  location,  clearly  within  the  normal  instrument  scan 
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during  the  approach,  and  its  close  association  with  indicated  airspeed. 

One  pilot  summed  it  up  this  way: 

"The  ground  speed,  especial1  ' ,ie  airspeed  indicator  where 
it's  so  in  the  field  of  scan  al.  die  time,  makes  you  very 
aware  of  what  the  wind  is  d how  it's  changing  and  what  to 
expect  from  a shear  standp.  int,  based  on  what's  being  reported 
on  the  ground." 

Some  of  the  pilots  reported  that  they  used  the  ground  speed 
display  to  compute  the  existing  head-wind/tail-wind  component,  and  there 
were  some  complaints  about  this  computational  workload.  It  seemed 
obvious  that  there  were  large  differences  in  the  understanding  of  how 
ground  speed  was  to  be  used.  In  the  words  of  one  pilot,  "You  told  us 
what  it  was  going  to  do,  but  not  how  I'm  supposed  to  react  to  it  from  a 
pilot's  standpoint."  The  comment  is  well  taken;  unless  the  subject  pilot 
was  already  somewhat  familiar  with  a concept,  the  four  approaches  devoted 
to  that  concept  probably  did  not  give  him  time  to  develop  his  own  notion 
as  to  how  best  to  use  it.  Even  if  we  had  been  able  to  brief  on  specific 
use  techniques,  the  opportunity  for  learning  or  rehearsing  them  would 
be  very  limited  within  the  four  approaches. 

The  general  consensus  was  that  having  ground  speed  displayed 
on  the  airspeed  indicator  was  helpful  and  a preferred  location,  but  that 
adding  a second  bug,  of  a different  color,  would  be  better  than  preempting 
the  command  bug.  It  was  also  suggested  by  one  pilot  that  the  Mach  limit 
needle  ("barber  pole")  could  be  used  to  display  ground  speed,  since  the 
Mach  limit  is  of  no  importance  during  approach  and  landing.  Another 
pilot  suggested  that  the  ground  speed  display  might  be  combined  in  some 
fashion  with  the  slow-fast  indicator;  his  reason  for  suggesting  this  was 
that  the  airspeed  bug  was  not  part  of  his  scan  on  short  final--below 
about  500  feet. 

One  of  the  pilots  who  did  not  see  this  concept  as  especially 
helpful  commented  that  the  use  of  the  airspeed  command  bug  for  ground 
speed  actually  disrupted  his  normal  scan,  and  that  this  would  require 
him  to  set  up  a whole  new  scan  procedure,  which  would  take  more  time 
than  was  available  during  the  study.  He  was  also  concerned  about  the 
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potential  for  confusing  the  ground  speed  bug  with  command  airspeed.  His 
contention  was: 

"...you'll  have  to  change  the  format.  It's  totally  unaccept- 
able to  have  it  above  the  airspeed  indicator.  When  it's  at 
either  end  of  the  indication  then  it's  out  of  your  scan  be- 
cause it's  not  within  the  range  of  airspeeds  you're  using  on 
the  approach--you  have  to  hunt  for  it,  and  then  you've  lost 
the  flight  director.  Conversely,  when  it  is  close  to  approach 
airspeed  indications,  you  have  a tendency  to  go  after  it... 
it  moves  and  unconsciously  you  add  or  subtract  power,  pull  the 
nose  up  or  down  to  chase  after  it.  No  matter  where  it  was, 
it  was  creating  problems." 

Crew  coordination  and  callouts  were  also  frequently  mentioned 
in  connection  with  the  ground  speed  display.  Apparently,  it  would  be 
acceptable  to  some  pilots  to  have  the  first  officer  or  flight  engineer 
calling  out  ground  speeds,  winds,  or  drift  components.  The  callouts 
were  suggested  as  a means  of  reducing  the  pilot's  workload,  especially 
in  mental  computation. 


3.  W ind  Difference  Indicator 


Pilot  assessments  of  the  Wind  Difference  Indicator  were  mixed, 
ranging  between  the  opinion  of  one  pilot  that  it  was  "very  effective  and 
would  reduce  operational  workload"  to  that  of  other  pilots  who  said  it 
"wasn't  worth  a damn"  and  "actually  degraded  performance."  The  pilots 
who  rated  this  concept  high  said  they  liked  it  because  it  gave  them  some 
anticipation  of  the  shear--a  feeling  for  what  lay  ahead  of  them  on  the 
approach--and  because  it  was  the  only  aiding  concept  in  the  set  that 
could  be  clearly  related  to  a pilot  action  for  coping  with  the  shear. 

As  they  said  it: 

"The  reason  I feel  we  are  both  commenting  on  the  wind  meter  and 
the  airspeed  is  that  they're  the  only  ones  that  are  giving  us 
information  as  to  what's  going  to  happen  to  us  and  what  we're 
suppose  to  do  before  it  happens.  The  rest  of  the  stuff  is 
after  the  fact... It  doesn't  do  any  good  to  anticipate  a shear 
because  you  don't  care,  you  know  the  shear's  there... You  want 
to  know  what  you're  supposed  to  do  to  get  through  it,  and  these 
are  the  only  things  that  helped  us,” 
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What  the  pilots  were  supposed  to  do,  of  course,  if  they  adopted 
the  procedure  suggested  in  the  briefings,  was  to  "pad"  their  previously 
selected  approach  airspeed  by  the  full  amount  of  any  negative  reading  of 
the  Wind  Difference  Indicator.  Most  of  the  pilots  did  experiment  with 
this  speed  pad  but  in  most  instances  did  not  add  as  much  airspeed  as  the 
wind  meter  called  for.  Some  of  the  pilots  were  uncertain  about  when  in 
the  approach  to  apply  (or  remove)  the  airspeed  pad  and  they  seemed  reluc- 
tant to  believe  that  excess  airspeed  would  in  fact  bleed  off  prior  to 
touchdown.  Quoting  one  pilot:  "The  readings  were  sometimes  hard  to 
believe,  but  they  turned  out  to  be  true." 

We  had  anticipated  that  pilots  would  have  some  difficulty  with 
the  Wind  Difference  concept  because  the  indicator  does  not  respond  directly 
to  control  inputs,  but  only  to  the  external  wind  environment.  A change 
on  the  meter  is  thus  seen  only  when  a change  occurs  in  winds  on  the  sur- 
face or  at  the  aircraft's  position.  Contrary  to  our  expectations,  however, 
pilots  reported  no  difficulty  in  this  aspect  of  meter  usage. 

The  location  of  the  wind  meter  on  the  panel  in  the  area  above 
the  altimeter  was  a problem  mentioned  by  nearly  every  one  of  the  evaluators. 
The  pilot's  normal  instrument  scan  does  not  include  this  area  and  they 
felt  that  some  training  would  be  necessary  before  they  wou'd  be  able  to 
scan  it  routinely.  The  test  display  used  for  this  concepc  was  also  small 
and  poorly  lighted  and  therefore  hard  to  read.  The  most  common  suggestions 
for  improving  the  concept  centered  on  revamping  the  display  and  locating 
it  nearer  the  radar  altimeter  or  airspeed  indicator--i. e. , on  either  side 
of  the  ADI.  Two  pilots  felt  that  the  positive-negative  sense  of  the  dis- 
play should  be  reversed,  so  that  negative  readings  would  be  above  zero 
and  mean  that  power  should  be  added  to  achieve  a corresponding  increase 
in  airspeed. 

The  wind  difference  information  was,  of  course,  displayed  head- 
up  as  well  as  head-down.  Pilot  comments  indicate  that  the  head-up  display 
was  almost  unanimously  preferred,  although  this  may  have  been  a "halo 
effect"  that  carried  over  from  the  generally  positive  evaluations  of  the 
HUD  concept.  Unquestionably,  the  Wind  Difference  Indicator  was  much 
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easier  to  see  in  the  HUD,  and  this  may  also  have  contributed  to  the  com- 
paratively high  ranking  of  the  HUD  when  the  wind  information  was  included. 
Interestingly,  when  pilots  were  asked  in  the  questionnaire  whether  the 
wind  meter  was  better  for  detecting  or  for  coping  with  wind  shear,  most 
of  the  responses  indicated  that  the  head-down  meter  was  better  for  detect- 
ing shear,  while  the  HUD  with  wind  meter  was  better  for  coping  with  shear. 

A frequently  reported  advantage  for  the  wind  meter  was  thac 
it  eliminated  the  mental  computations  associated  with  estimating  wind 
effects  when  parameters  such  as  INS  wind  or  ground  speed  are  used.  The 
pilots  in  this  evaluation  were  very  sensitive  to  any  requirement  for 
mental  computations  during  the  approach,  with  this  sensitivity  most 
often  manifested  in  reports  of  increased  workload.  Opinions  as  to  the 
effect  of  the  wind  meter  on  operational  workload  were  almost  evenly  divided 
between  increase  and  decrease.  Location  and  display  format  were  cited  as 
reasons  for  the  expected  increase  in  workload. 

4.  Head-up  Displays 

Pilot  reactions  to  the  head-up  displays  were  more  complex  and 
varied  than  for  any  of  the  other  aiding  concepts.  Their  overall  reaction 
was  probably  best  expressed  by  the  pilot  who  commented  that  "...on  the 
first  couple  of  runs  I was  kind  of  in  the  dark,  but  then  we  started  glu- 
ing each  individual  piece  together  and  I think  it  makes  more  sense— at 
this  point  I think  it  will  definitely  have  some  value  if  we  can  sort  it 
all  out."  This  pilot  was  referring  to  the  separate  elements  of  the  basic 
display  format,  but  the  reaction  applies  more  generally  to  the  many  unre- 
solved issues  associated  with  the  head-up  display  (HUD)  concept  and  its 
application  to  the  wind-shear  problem. 

The  most  enthusiastic  advocate  of  the  HUD  concept  was  a pilot 
who  had  a remarkable  ability  to  screen  out  the  more  troublesome  features 
of  the  concept  and  to  use  only  those  elements  of  the  display  that  he  found 
helpful.  He  felt  that  the  reference  flight-path  angle  element  (the  cir- 
cle), together  with  airspeed,  were  excellent  aids  for  detecting  and  cop- 
ing with  the  low-level  shear,  especially  for  the  transition  from  instru- 
ments to  visual  reference.  However,  this  pilot  deliberately  excluded 
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the  flight-path  angle  and  potential  flight-path  angle  elements  from  his 
scan  on  his  initial  exposures  to  the  HUD  and  included  them  later  only 
because  he  felt  an  evaluation  of  these  elements  was  expected. 

The  other  evaluators  did  not  attempt  to  "sort  it  all  out"  in 
this  manner  and  generally  attempted  to  use  the  full  HUD  from  the  outset. 
Their  assessments  of  the  potential  usefulness  of  the  HUD  were  generally 
positive,  but  all  of  them  had  some  kind  of  complaint  about  what  was  pre- 
sented, how  it  was  displayed,  and/or  how  to  use  the  display.  Only  one 
of  the  eight  pilots  felt  that  the  HUD,  as  it  was  represented  in  the  simu- 
lation was  "not  acceptable  at  all."  His  criticisms  of  HUD  ranged  from 
a conviction  that  the  display  elements  dynamics  did  not  match  the  response 
of  the  aircraft  to  his  control  inputs,  to  a rejection  of  the  display  con- 
tent and  format  as  "incomplete"  (no  ILS  information)  and  "primitive" 
(relative  to  an  operational  system  he  had  flown). 

There  was  a definite  trend  toward  more  positive  acceptance  of 
the  HUD  with  increasing  exposure  across  the  three  sessions  in  which  it 
was  used.  Pilot  comments  following  the  first  session  were  more  often 
noncommittal  (e.g.,  "It's  a new  concept. ..I  found  it  very  interesting"; 

"It  was  less  difficult  to  fly  than  I anticipated")  and  only  two  of  the 
eight  pilots  felt  they  had  adequate  time  to  evaluate  the  concept.  After 
the  second  sessions,  the  comments  were  more  in  terms  of  specific  ways 
the  HUD  was  helpful  and  four  of  the  pilots  felt  the  time  for  evaluation 
was  adequate.  Finally,  after  the  third  exposure,  terms  like  "outstand- 
ing," "highly  successful,"  "certainly  an  advantage,"  and  "very  useful" 
appeared  in  the  pilot  comments. 

The  HUD  features  cited  most  often  as  limiting  its  operational 
usefulness  were: 

(1)  The  lateral  displacement  of  the  3-degree  flight-path 
reference  circle  in  a strong  cross-wind  situation. 

(2)  The  excessive  activity  and  instability  of  the  flight- 
path  angle  and  potential  flight-path  angle  elements, 
especially  in  turbulence. 

(3)  The  apparent  lack  of  coherence  in  the  overall  display 
con f i gurat i on-- i , e. , the  tendency  for  the  display  ele- 
ments to  move  apart  or  in  seemingly  unrelated  ways, 
during  the  shear  encounter. 
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The  most  positive  comments  relating  to  the  head-up  display  of 
flight-path  angle  were  those  associated  with  the  IFR-VFR  transition  con- 
dition. One  pilot  stated  that: 

"...what  I had  then  was  excellent--very,  very  good.  I couldn't 
speak  enough  for  having  that  airspeed  presentation  there  with 
the  circle,  in  that  order  of  priority,  and  then  the  flight  path 
angle  bars... The  minute  that  airspeed  started  to  move,  to  decay, 
and  it  was  not  responding  to  my  throttle  response,  and  then  when 
I looked  over  and  saw  that  the  predicted  glide  path  angle  circle 
was  moving  towards  me,  I knew,  there  was  no  doubt  in  my  mind, 
that  the  present  aircraft  configuration  was  not  going  to  resolve 
it... So  I have  to  apply  different  techniques--f lap  retraction, 
go-around  low.  No  doubt  I had  cues  that  I normally  would  not 
have  got  in  that  timely  a fashion." 


Pilot  assessments  of  the  potential  flight-p 
generally  negative,  probably  because  of  the  unfamilia 
tion  provided  and  of  the  excessive  activity  of  this  d 
tive  to  the  flight-path  angle  bar.  However,  most  of 
that  they  provided  anticipatory  information  for  manag 
display  element  was  the  one  pilots  most  often  ignored 
much  more  experience  with  for  a proper  evaluation. 
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5 . INS  Wind  Readout 

Seven  of  the  eight  pilots  commented  that  the  INS  Wind  Readout 
alerted  them  to  the  shear  condition  by  providing  information  they  could 
compare  with  the  surface  wind  report.  All  of  them  were  familiar  with 
the  potential  usefulness  of  this  concept  and  thought  the  availability 
of  current  information  on  the  winds  presently  affecting  the  airplane 
would  help  them  manage  the  approach. 


As  we  anticipated,  the  negative  comments  were  directed 
difficulty  in  including  this  information  in  the  normal  instrument 
during  an  approach  and  to  the  mental  workload  required  to  monitor 
detect  significant  changes  in  wind  effects.  The  almost  unanimous 
tion  taken  on  the  resolution  of  these  problems  was  to  assign  the 
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monitoring  task  to  the  First  Officer,  and  have  him  call  out  significant 
wind  changes  and/or  potential  shear  conditions. 

6.  Shear  Advisories 

Seven  of  the  eight  pilots  felt  that  the  wind-shear  advisory 
messages  would  help  them  to  anticipate  the  occurrence  of  significant 
low-level  shear  and  that  it  would  be  desirable  to  have  this  information 
prior  to  starting  the  approach.  Most  of  the  pilots  stated  that  they 
would  modify  their  usual  approach  management  procedures  on  the  basis  of 
the  shear  advisory;  however,  only  three  of  eight  pilots  actually  indicated 
that  they  would  not  proceed  after  reading  an  advisory.  In  the  four  in- 
stances where  pilots  did  elect  to  go-around  on  reading  the  advisory,  we 
requested  that  they  attempt  the  approach  for  data;  three  of  these  ap- 
proaches resulted  in  short  landings  (in  the  approach  lights)  and  one  in 
a go-around. 

The  principal  difficulty  with  advisories  represented  in  this 
study,  according  to  seven  of  the  eight  pilots,  was  that  the  structure 
of  the  messages  was  too  complex  and  the  language  was  not  sufficiently 
clear.  In  the  words  of  one  evaluator; 

"The  criticism  is  that  it  needs  to  have  a format  change  in  that 
there  is  too  much  verbiage  in  it  and  it's  not  structured... 

You're  talking  about  'positive  and  negative'  and  'head  wind- 
tail  wind'  all  in  the  same  report  and  format.  That  is  definitely 
a very  negative  value. ..It's  too  lengthy  and  voluminous  to  be 
a good  memory  item." 

In  one  way  or  another,  most  of  the  pilots  put  in  a plea  for 
both  brevity  and  for  some  way  of  organizing  the  information  by  approach 
segment  or  altitudes  so  that  they  could  get  a clearer  picture  of  what 
to  expect  and  where  in  the  approach  it  would  happen.  The  suggestion  of 
two  of  the  pilots  was  to  describe  the  wind  shear  effect --i. e. , an  expected 
change  in  airspeed,  rather  than  the  changes  in  wind  velocity  or  direction; 
"I  would  say  that  if  you  gave  the  wind  and  where  the  shear  takes  place 
and  say  expect  a 15-knot  change  of  airspeed--or  drop  in  airspeed--that 
would  be  a big  help."  Most  of  the  pilots  felt  that  they  would  need  some 
sort  of  reminder  of  reported  shear  conditions  as  the  approach  proceeded. 


The  general  recommendation  was  to  have  the  First  Officer  call  out  the 
expected  changes  to  alert  the  pilot  flying  the  approach,  but  there  was 
little  agreement  on  when  and  how  this  might  be  accomplished. 

One  of  the  pilots  had  a high  regard  for  the  shear  advisory 
information  but  was  suspicious  of  actually  getting  it  in  the  operational 
s ituation : 

"They  were  magic,  right  on  target.  They  were  practically  equiva- 
lent to  a display,  but  of  course  in  the  real  world  you  wouldn't 
see  this  because  no  one  could  update  the  rapidly  changing  condi- 
tion on  the  approach  to  give  you  that  kind  of  inf orma tion. . . I 
felt  that  to  try  to  apply  the  advisories  directly  to  the  flight 
could  lead  into  a trap.  You  would  be  in  anticipation  of  some- 
thing that  wasn't  really  going  to  happen  or  it  might  actually 
be  the  reverse." 

Two  of  the  pilots  mentioned  an  unexpected  effect  the  advisories 
might  have  on  the  pilot's  anticipation  of  shear:  that  it  might  make  them 
too  apprehensive  and  over-react  to  the  actual  shear  encounter.  One  of 
them  said  he  would  sometimes  imagine  the  severity  of  the  shear  to  be 
greater  than  it  actually  turned  out  to  be.  The  other  pilot  reported  that 
his  apprehension  led  him  to  try  to  ouc-guess  the  shear  rather  than  follow 
what  his  instruments  were  telling  him,  and  that  this  resulted  in  an  un- 
necessary go-around. 


Pane 1 D i s p lay  of  Flight -Path  Angle 


Pilots  were  unanimous  in  their  rejection  of  this  concept,  pri- 
marily on  the  basis  of  its  poor  location  and  the  difficulties  they  had 
in  both  reading  the  instrument  and  appreciating  the  relevance  or  useful- 
ness of  the  information  it  provided.  All  of  the  eight  pilots  complained 
about  the  deficiencies  in  how  the  information  was  presented,  with  one 
pilot  expressing  it  most  succinctly: 


"The  damned  presentation  is  too  small  to  be  of  any  good. 
You've  got  to  get  it  on  a bigger  gauge  and  a bigger  needle 
and  maybe  then  it  could  show  you  that... I'm  not  sure  that 
even  then  it  vrould  tell  you  much  down  when  you  get  out  of 
400  or  500  feet,  and  where  it  gets  iffy  whether  you're  go- 
ing to  make  the  runway  or  not  with  shear." 
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The  latter  part  of  this  pilot's  statement  is  important  because 
it  points  up  the  fact  that  even  with  the  display  problems  resolved,  pilots 
might  not  find  the  information  particularly  useful.  It  was  the  on-site 
Test  Director's  impression  that  the  panel  display  of  flight-path  angle 
was  not  used  by  at  least  half  of  the  pilots;  perhaps  the  poor  presenta- 
tion allowed  them  to  evade  the  more  troublesome  task  of  attempting  to 
understand  and  use  the  informat ion.  Positive  assessments  of  the  opera- 
tional usefulness  of  flight-path  angle  information  tended  to  be  vague  and, 
in  almost  all  instances  to  be  qualified  by  the  assertion  that  some  other 
instrument  did  a better  job  of  providing  the  same  information.  The  fol- 
lowing quotes  are  typical: 


"The  information  is  useful  and  interesting  when  you  initiate 
the  approach  and  as  long  as  conditions  are  relatively  steady 
state  it  does  give  you  an  indication  that  is  useful... I per- 
sonally don't  see  any  advantage  of  this  over  a ground  speed 
display. " 

"I  think  it  provided  a clue  to  me  of  whether  I had  a tail  or 
head  wind  because  that's  about  all  it  did  for  me.  I could 
detect  the  same  thing  basically  on  the  IVSI." 

"It  was  very  easy  to  recognize  head  wind  and  tail  wind  with 
relation  to  the  pointer.  But  that  was  basically  about  the 
only  value  I was  able  to  get  out  of  it." 


Four  of  the  eight  pilots  simply  rejected  the  concept,  saying 
"...it  was  just  something  I was  trying  to  do  because  it  was  there  and 
you  guys  asked  me  to  do  it... I wouldn't  use  it,  I wouldn't  even  look 
at  it  or  use  it  at  all."  "I  don't  like  it;  I wouldn't  want  it  and  have 
no  use  for  it."  "Can  I use  four  letter  words?  I didn't  care  for  the 
instrument."  More  significant  than  the  common  complaints  about  the 
out-of-scan  location  and  poor  readability  of  the  display  were  the  comments 
of  two  of  the  pilots  that  attempts  to  use  the  display  on  the  low  end  of 
the  approach  would  degrade  their  control  of  the  aircraft  by  reference  to 
primary  instruments  or  external  visual  reference. 

8.  VSI  C round  Speed  Placard 


Most  of  the  pilots  were  intrigued  with  this  device  and  felt 
that  it  had  some  merit  in  alerting  them  to  wind  shear  whenever  they  could 
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keep  the  approach  reasonably  stable  on  the  3-degree  glide  path.  They 
all  commented  on  the  difficulty  of  including  the  VSI  in  their  scan  and 
of  attempting  to  interpret  the  ground  speed  reading  when  the  VSI  needle 
was  bouncing  around  in  turbulence.  Some  of  them  felt  they  could  do  about 
as  well  using  other  instrument  indications,  and  none  of  the  pilots  felt 
strongly  about  adopting  this  concept. 

D.  Approach  Outcomes  Using  Aiding  Concepts 

An  overview  of  approach  outcomes  is  presented  in  Figures  15  and  16 
for  each  of  the  candidate  pilot  aiding  concepts  just  discussed.  The  data 
plots  are  the  proportion  of  go-arounds  and  within-limits  approaches,  and 
were  derived  following  the  procedure  described  earlier  for  baseline  condi 
tions  (see  Section  IV-B).  Data  points  are  again  coded  to  show  the  dif- 
ferential effects  of  the  four  wind-shear  conditions.  The  first  test  cond 
tion  in  each  figure  (BL)  represents  baseline  systems  performance  on  the 
pilot's  second  exposure  to  the  shears  (ILS  2 in  Figure  14),  and  was  in- 
cluded here  to  facilitate  the  contrast  with  performance  using  the  aiding 
concepts . 

Figure  15  presents  the  approach  outcome  summaries  for  the  shear 
advisory  (ADV)  and  the  aiding  concepts  representing  alternative  ways 
of  augmenting  existing  panel  instruments.  All  of  these  "head-down" 
concepts  were  evaluated  under  the  same  set  of  test  conditions--i. e. , 
full  ILS  guidance,  manual  control  using  flight  director.  Category  1 
weather  (2400  feet  RVR) , and  the  same  runway  environment.  Also,  the 
data  points  shown  for  each  test  shear  are  all  based  on  eight  runs,  one 
for  each  evaluation  pilot. 

Approach  outcome  summaries  for  the  Head-up  Display  (HUD)  aiding 
concept  are  presented  separately  in  Figure  16  to  call  attention  to  the 
fact  that  test  conditions  for  evaluating  this  concept  were  not  the  same 
as  those  just  cited.  It  will  be  recalled  from  the  discussion  of  study 
procedures  in  Section  III  that  all  eight  pilots  were  exposed  to  the  HUD 
in  the  same  order.  On  the  first  run  series,  the  basic  HUD  (no  wind  dif- 
ference information)  was  used  as  the  primary  reference  for  flight-path 


55 


SHEAR  PROFILES 


1.0 

0.8 

PROPORTION 

0.6 

GOING 

AROUND 

0.4 

0.2 

0 


A 

AA 

□A 

■ 

■ 

□ 

■ WS  1 
□ WS  2 
▲ WS  3 
A WS  4 


A 


A 


□A 

1_ 


A 

a 

▲ 


A 


A 


1.0 

0.8 

PROPORTION  06 
WITHIN 

LIMITS  0.4 

AT  100  FT 

0.2 


_ A 

a 

— A A 

■ 

— A 


* 

□A 


1 


A 


□A 


1 


1.0 

f— 

■A 

a 

o 

n 

QA 

AO 

■ 

■ 

0.8 

- s 

A 

* 

A 

PROPORTION 

0.6 

▲ 

i 

A 

WITHIN 

■ 

A 

□ 

LIMITS  AT 

0.4 



AA 

TOUCHDOWN 

0.2 

— 

A 

0 



I I I Ju  J 


TEST  CONDITION 

BL 

ADV 

VSI- 

INS 

G.S. 

WIND 

PNL 

G.S. 

WIND 

DIFF 

FPA 

SA-4364-2 


FIGURE  15  SUMMARY  OF  APPROACH  OUTCOMES  FOR  SHEAR  ADVISORIES 
AND  HEAD-DOWN  DISPLAY  CONCEPTS 
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FIGURE  16  SUMMARY  OF  APPROACH  OUTCOMES  FOR  HEAD-UP  DISPLAY  CONCEPTS 


control  throughout  a night  visual  approach;  no  glide-slope  guidance  was 
available  on  these  runs  and  visibility  was  unrestricted.  (This  condition 
is  identified  in  Figure  16  as  HUD  VIS).  The  second  HUD  series  was  an 
ILS  approach  similar  to  baseline  conditions  down  to  the  breakout  altitude 
of  400  feet;  at  that  point,  however,  visibility  was  unrestricted  and  the 
pilot  transitioned  to  external  visual  reference  using  the  basic  HUD  (HUD 
TRANS  in  Figure  16).  Test  conditions  on  the  third  HUD  series  were  again 
unrestricted  visibility  with  no  glide  slope  and  the  pilot  used  the  HUD 
with  the  Wind  Difference  Indicator  incorporated  (HUD  AW  in  Figure  16). 


E.  Contrast  with  Baseline  Performance 


The  general  pattern  of  approach  outcome  data  plots  reflects  the 
expected  confounding  of  differences  between  aiding  concepts  with  dif- 
ferences in  the  wind  shear  profiles.  Higher  go-around  rates  for  the 
"head  down"  aiding  concepts  are  consistently  associated  with  the  thunder- 
storm shear  (WS-4),  but  this  trend  is  not  apparent  for  the  HUD.  For  the 
other  shear  profiles,  there  is  a trend  toward  lower  go-around  rates  rela- 
tive to  baseline,  but  no  obvious  differences  across  aiding  concepts. 


The  pattern  of  data  plots  for  within-1  imits  approach  outcomes  at 
100  feet  and  at  touchdown  does  begin  to  show  some  differential  effects 
for  aiding  concepts.  The  following  contrasts  with  baseline  performance 
are  noteworthy: 


(1)  At  the  100-foot  point,  approach  outcomes  were  generally 
worse  than  baseline  for  the  Shear  Advisories  and  VSI- 
Groundspeed  concepts;  some  improvement  over  baseline  per- 
formance is  indicated  for  the  Ground-Speed  concept  on 
profili'  4 and  for  the  HUD  transition  condition  on  shears 

1 and  3. 

(2)  Touchdown  data  indicate  some  improvement  over  baseline 
performance  for  all  of  the  aiding  concepts  except  the 
Shear  Advisories  and  the  initial  HUD  series  (HUD  VIS). 

(3)  Improvements  over  baseline  in  touchdown  performance 
appear  to  be  most  consistent  (across  shear  conditions) 
and  of  greater  magnitude  for  the  VSI-Ground-Speed  and 
HUD  transition  concepts,  in  that  order. 

(4)  Touchdown  performance  was  generally  better  than  approach 
outcomes  at  100  feet  and  less  variable  across  shears; 
this  indicates  that  pilots  were  often  able  to  convert  an 
out -of - 1 im i t s approach  to  a within-1 imi ts  touchdown. 
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F. 


Contrast  with  Pilot  Assessments 


The  correspondence  between  approach  outcomes  and  pilot  ratings  of 
the  most  helpful  aiding  concepts  is  quite  good  for  the  pilot's  first  and 
second  choices.  Performance  using  the  top-rated  Ground  Speed  display  was 
not  as  good  as  the  lowest  rated  VSI  Ground  Speed  placard;  considered  to- 
gether, however,  these  data  plots  indicate  the  potential  effectiveness  of 
providing  ground-speed  information  to  the  pilot.  A comparatively  high 
proportion  of  within-limits  landings  is  also  indicated  for  the  Wind  Dif- 
ference Indicator,  especially  when  the  head-up  version  is  considered. 

High  pilot  ratings  for  VASI  are  also  supported  by  the  data  plots  shown 
earlier  in  Figure  14. 

It  is  also  of  interest  to  note  that  the  performance  using  the  low- 
rated Shear  Advisories  was  generally  poorer  than  baseline.  However,  ap- 
proach outcomes  for  the  rejected  panel  display  of  flight-path  angle  (PNL 
FPA  in  Figure  15)  were  about  the  same  as  baseline.  This  result  is  con- 
sistent with  the  pilot  reports  that,  for  the  most  part,  they  did  not  use 
the  head-down  flight-path  angle  information. 

The  relative  ef fecti.\/eness  of  the  candidate  pilot  aiding  concepts 
can  be  summarized  by  considering  the  same  over-all  ratios  of  within- 
limits  touchdowns  as  those  used  in  Section  IV-B  to  contrast  alternative 
baseline  conditions.  These  ratios  relate  the  number  of  within-limits 
approach  outcomes  to  the  total  number  of  approaches  attempted  across  all 
four  shear  conditions.  The  number  of  within-limits  landings  recorded 
for  the  second  baseline  series  (ILS-2)  and  for  each  of  the  candidate 
aiding  concepts  are  as  follows  (corresponding  percentages,  shown  in  paren- 
theses, are  based  on  a total  of  32  runs  under  each  condition): 


Baseline  (ILS-2) 

17 

(53%) 

Shear  Advisory 

13 

(41%) 

VSI -Ground  Speed 

20 

(63%) 

INS  Wind  Readout 

21 

(66%) 

Ground  Speed 

21 

(66%) 

Wind  Difference  Indicator 

21 

(66%) 

Panel  Flight  Path  Angle 

20 

(63%) 

HUD  (Visual  Approach) 

15 

( .7"i 

HUD  (transition) 

21 

(667) 

HUD  (Wind  difference) 

26 

(81%) 
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CONCLUSIONS  AND  RECOMMENDATIONS 


The  principal  intent  of  this  exploratory  study,  as  stated  in  the 
introduction,  was  to  provide  an  early  determination  of  the  need  for  im- 
proved cockpit  aids  and  procedures  for  coping  with  low-level  wind  shear 
and  to  provide  guidelines  for  the  subsequent  development  and  testing  of 
promising  pilot  aiding  concepts.  Summary  statements  concerning  the  need 
for  improvement  and  the  outcome  of  the  survey  evaluation  of  candidate 
aiding  concepts  are  given  below  as  the  conclusions  of  this  phase  of  the 
investigation.  Guidelines  for  subsequent  evaluation  and  testing  of 
these  aiding  concepts  are  then  presented  as  recommendations  for  Phase  2. 


A.  Need  for  Improvement 

Conclusions  relating  to  the  need  for  improved  pilot  aiding  are  as 
follows: 

(1)  Approach  outcomes  under  baseline  conditions  indicate  that 
pilots  will  not  be  able  to  cope  successfully  with  the 
more  severe  low-level  wind  shears  using  existing  flight 
instruments  and  procedures.  Only  52%  of  the  manually 
flown  precision  ILS  approaches  resulted  in  within-limits 
landings,  and  performance  was  slightly  worse  for  the 
coupled  approach  and  non-precision  approach  using  the 
VDP  procedure.  Performance  was  somewhat  better  on  the 
VFR  approach  using  VASI  (71%  within-limits  landings). 

(2)  Pilots  are  generally  unfamiliar  with  the  potential 
hazard  of  severe  low-level  shear.  None  of  the  evaluation 
pilots  in  this  study,  with  pilot-in-command  time  averag- 
ing about  15,000  hours,  had  experienced  shear  conditions 
as  severe  as  those  represented  in  the  simulation.  It  is 
also  instructive,  in  this  regard,  to  note  that  the  availa- 
bility of  wind-shear  advisories,  alerting  the  pilots  to 
the  presence  of  substantial  changes  in  wind  speed  and 
direction  on  the  approach,  did  not  produce  any  improvement 
in  either  approach  outcomes  (they  were  slightly  worse)  or 
approach  management. 


B . Outcomes  of  the  Aiding  Concept  Evaluation 


The  following  are  the  conclusions  regarding  evaluation  of  the  aiding 
concepts: 

(1)  Based  on  pilot  assessments,  the  most  romising  aiding  con- 
cept was  the  display  of  ground  speed  in  close  association 
with  the  airspeed  indicator. 

(2)  Pilots  also  expressed  a high  regard  for  the  Wind  Difference 
Indicator,  especially  when  this  information  was  presented 
in  the  head-up  display. 

(3)  The  availability  of  some  form  of  vertical  flight-path 
guidance  and  airspeed  management  information  in  the  HUD 
was  considered  to  be  very  helpful  by  most  of  Che  pilots. 
However,  flight-path  angle  and  potential  flight-path 
angle,  as  represented  in  the  HUD  simulation,  were  gener- 
ally regarded  as  unacceptable  because  of  excessive  activ- 
ity of  the  display  elements  in  turbulence  and  shear  and 
because  of  the  difficulties  of  interpreting  the  informa- 
tion provided. 

(4)  The  panel  display  of  flight-path  angle  and  potential 
flight-path  angle  was  generally  regarded  as  useless, 
primarily  because  of  discrepancies  in  the  location  and 
readability  of  the  display  but  also  because  of  diffi- 
culties in  interpreting  the  information  and  applying  it 
to  the  wind-shear  problem. 

(5)  Wind-shear  advisory  messages  were  assessed  as  a sound 
operational  concept  (pilots  wanted  them  provided  in  the 
operational  situation),  but  they  were  considered  to  be 
too  complex  and  unclear  to  be  useful.  Changes  in  format 
and  language  were  strongly  recommended. 

(6)  Approach  outcome  data  generally  supported  the  pilot 
assessments.  However,  differences  in  performance  across 
aiding  concepts  did  not  appear  to  be  significant  except 
for  the  comparatively  poor  performance  with  the  shear 
advisories  and  initial  runs  using  the  HUD. 

(7)  All  of  the  aiding  concepts  examined  provided  some  in- 
formation that  the  pilots  could  use  to  anticipate  wind 
shear  and/or  to  detect  the  effects  of  the  shear  during 
the  encounter.  However,  with  only  one  exception  (the 
Wind  Difference  Indicator),  no  explicit  guidano  was 
provided  to  the  pilots  for  using  the  information  for 
planning  the  approach,  assessing  the  progress  of  tin 
approach,  or  taking  corrective  actions.  Pilot  re- 
ported little  difficult'  in  understanding  tin  basic  con- 
cepts, but  they  did  not  have  time  to  develop  a method  of 
using  the  information  displayed  to  do  a better  job  of 
coping  with  wind  shear. 


Recommenda t ions  for  Phase  2 


The  following  are  the  recommendations  for  further  development  of 
the  aiding  concepts  in  Phase  2: 

(1)  Continue  the  development  and  testing  of  panel  displays  of 
ground  speed  and  wind  difference  as  the  most  promising 
near-term  aiding  concepts. 

(2)  Further  development  of  the  flight-path  angle  and  potential 
flight-path  angle  should  be  carried  out  analytically  and 
with  simulation  to  resolve  the  problem  of  the  excessive 
activity  and  incorrect  readings  in  turbulence  and  vertical 
wind  shear. 

(3)  Develop  explicit  pilot  procedures  for  using  any  aiding 
concept  selected  for  Phase  2 evaluation  before  additional 
simulator  testing  is  scheduled. 

(4)  Continue  the  development  of  wind  shear  advisories  as  a 
"hazard  alert"  message  that  will  be  available  to  pilots 
whenever  weather  conditions  in  the  vicinity  of  the  ap- 
proach or  takeoff  flight  path  are  anticipated;  revisions 
to  the  format  and  language  should  be  oriented  toward 
alerting  the  pilot  to  the  location  of  significant  shear 
(position  and  altitude)  and  expected  effects  (e.g., 
magnitude  of  airspeed  loss)  rather  than  a description  of 
the  wind  velocity  profile. 


D.  Concluding  Remarks 


One  of  the  more  significant  observations  of  Phase  1 testing  was  that 
the  evaluation  pilots  did  not  expect  shears  of  the  difficulty  or  intensity 
of  those  used  in  the  program.  As  one  team  member  said,  "Shears  of  this 
magnitude  are  not  only  not  expected , they  are  not  generally  imagi nod . " 

It  is  therefore  recommended  that  airline  training  programs  incorpo- 
rate exposure  to  severe  shears,  and  that  this  exposure  include  shears  of 
such  nature  and  intensity  as  to  dictate  a go-around  decision.  The  ra- 
tionale for  this  recommendation  is  twofold:  (1)  Airline  pilots  should 
he  aware  of  the  intensity  and  aerodynamic  effects  that  characterize 
severe  shear  environments,  and  (2)  the  training  process  should  emphasize 
the  fact  that  a decision  to  go-around  is  appropriate  in  the  presence  of 
some  shears. 


b2 


It  is  further  recommended  that  airline  training  programs  specifi- 
cally treat  aerodynamic  effects  of  shear.  We  heard  a number  of  evalua- 
tion pilots  complain  of  sluggish  response  to  throttle  inputs  in  the 
simulator;  we  feel  that  the  shear  effects  may  have  been  responsible  for 
the  "sluggish"  acceleration.  The  pilot  may  have  been  unable  to  distin- 
guish between  these  aerodynamic  effects  of  the  shear  environment  and  the 
response  of  the  simulator  thrust  computation  itself. 

Crew  coordination  is  an  important  factor  that  was  not  fully  explored 
in  this  study.  Evaluation  pilots  often  expressed  the  desire  to  have  the 
first  officer  relay  display  information,  such  as  speeds,  altitudes,  winds, 
errors,  and  so  forth.  Clearly,  such  callouts  require  planning  and  coordi- 
nation, both  to  ensure  a reliable  and  timely  flow  of  information  to  the 
pilot  flying  and  to  ensure  that  at  least  one  pilot  still  has  sufficient 
time  head-up  to  permit  visual  detection  of  cues  and/or  other  aircraft. 
However,  simply  shifting  part  of  the  instrument  scan  to  the  first  officer 
may  not  be  an  optimal  way  of  unburdening  the  pilot  flying  when  low-level 
shear  occurs  in  the  range  of  altitudes  at  which  the  crew  is  "going  visual"- 
i.e.,  looking  for  or  flying  with  reference  to  outside  visual  cues.  The 
onset  of  a shear  is  more  detectable  on  instruments  than  by  unaided  visual 
reference,  and  it  therefore  seems  necessary  that  crew  procedures  be  de- 
signed to  ensure  that  one  pilot  is  always  on  instruments  for  earliest 
detection  of  the  shear. 
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